-- Logs begin at Wed 2022-01-19 00:20:27 UTC, end at Wed 2022-01-19 01:20:03 UTC. -- Jan 19 00:50:24.595326 dv-cinder-799871-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 00:50:24.604185 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 00:50:24 2022] *** Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: nodename: dv-cinder-799871-14-iscsi Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: machine: x86_64 Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: clock source: unix Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: pcre jit disabled Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: detected number of CPU cores: 4 Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: current working directory: / Jan 19 00:50:24.606250 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: detected binary path: /usr/bin/uwsgi-core Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: your processes number limit is 47680 Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: your memory page size is 4096 bytes Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: detected max file descriptor number: 2048 Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: lock engine: pthread robust mutexes Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: thunder lock: enabled Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 00:50:24.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 00:50:24.650969 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: Python main interpreter initialized at 0x55620d42e9c0 Jan 19 00:50:24.650969 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: python threads support enabled Jan 19 00:50:24.650969 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: your server socket listen backlog is limited to 100 connections Jan 19 00:50:24.650969 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: your mercy for graceful operations on workers is 90 seconds Jan 19 00:50:24.651383 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 00:50:24.651383 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: *** Operational MODE: preforking *** Jan 19 00:50:24.651659 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: *** uWSGI is running in multiple interpreter mode *** Jan 19 00:50:24.651659 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: spawned uWSGI master process (pid: 101856) Jan 19 00:50:24.651894 dv-cinder-799871-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 00:50:24.653304 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: spawned uWSGI worker 1 (pid: 101857, cores: 1) Jan 19 00:50:24.653304 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: spawned uWSGI worker 2 (pid: 101858, cores: 1) Jan 19 00:50:24.653304 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 00:50:26.431315 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:50:26.431315 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: from cryptography.utils import int_from_bytes Jan 19 00:50:26.431986 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:50:26.431986 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: from cryptography.utils import int_from_bytes Jan 19 00:50:26.442721 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:50:26.442721 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: from cryptography.utils import int_from_bytes Jan 19 00:50:26.443211 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:50:26.443211 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: from cryptography.utils import int_from_bytes Jan 19 00:50:29.047231 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 00:50:29.048215 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 00:50:29.048357 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 00:50:29.048357 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 00:50:29.048891 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 00:50:29.049014 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 00:50:29.049135 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 00:50:29.049135 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 00:50:29.049351 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 00:50:29.049351 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 00:50:29.049799 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.049799 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050020 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050127 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050234 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050354 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050485 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050583 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050686 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050787 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.050898 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052094 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052094 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052094 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052094 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052451 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052557 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052644 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052716 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-14-iscsi {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052838 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.052975 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053116 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053224 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053431 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053638 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053762 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.053899 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054053 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054185 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-14-iscsi {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054379 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054511 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054684 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054822 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.054997 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.055180 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.055320 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.056751 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.056941 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057049 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057119 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057190 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057256 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057329 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057417 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057485 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057577 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057677 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057752 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057818 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057895 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.057993 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.058080 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.058778 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.058978 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.059173 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.059360 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.059545 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.059728 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-14-iscsi {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.059907 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.060102 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.060282 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.060462 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.060655 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.060856 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.061138 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-14-iscsi {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.061328 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.061526 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.061766 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.061962 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.062144 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.062297 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.062543 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.062760 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.062954 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063150 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063321 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063491 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063614 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063762 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.063936 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064063 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064210 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064337 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064487 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064669 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064797 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.064929 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065070 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065198 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065350 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065484 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065484 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.065748 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066032 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066159 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066292 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066412 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066412 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066652 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066773 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066974 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.066974 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067267 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067390 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067508 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067642 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067777 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.067902 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068030 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068030 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068288 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068424 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068577 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068733 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068864 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.068864 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069103 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069236 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069358 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069478 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069675 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069807 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.069945 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070070 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070192 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070321 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070441 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070562 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070691 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070811 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.070931 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071051 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071172 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071360 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071527 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071680 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071825 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.071968 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072113 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072258 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072410 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072554 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072698 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.072878 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073028 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073186 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073335 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073487 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073671 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.073856 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074003 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074157 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074303 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074458 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074611 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074758 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.074910 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.075083 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.075268 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.075417 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076090 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076316 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076473 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076634 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076782 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.076935 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.077152 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.077332 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.077508 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.077707 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.077859 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078015 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078168 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078325 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078483 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078631 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078783 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.078929 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079081 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079236 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079394 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079545 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079697 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079846 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.079991 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080140 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080295 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080446 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080591 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080743 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.080896 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081039 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081192 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081487 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081654 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081809 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.081969 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082124 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082271 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082271 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082550 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082704 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.082866 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083049 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083200 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083349 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083504 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083659 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083829 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.083980 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084128 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084277 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084431 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084587 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084745 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.084896 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.085054 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.085214 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.085381 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.085530 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.085880 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086035 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086181 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086339 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086560 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086715 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.086870 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087016 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087183 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087365 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087536 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087689 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.087844 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088003 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088150 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088295 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088440 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088591 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088744 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.088889 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089036 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089189 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089335 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089488 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089655 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089804 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.089957 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090120 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090276 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090430 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090579 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090726 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.090873 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.091020 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.091214 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.091879 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092028 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092176 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092322 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092480 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092628 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092797 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.092952 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093114 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093286 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093442 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093668 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093818 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.093971 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.094116 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.094261 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.094406 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.094565 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.094711 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:50:29.094864 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095009 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095162 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095308 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095461 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095606 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095758 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.095904 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096049 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096200 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096369 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096515 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096706 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096853 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.096997 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.097156 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.097317 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.097510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.097709 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.097860 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098009 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098171 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098328 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098486 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098643 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098793 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.098943 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099100 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099262 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099411 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099583 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099744 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.099898 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100061 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100213 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100375 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100533 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100683 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100833 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.100993 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101143 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101309 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101465 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101644 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101791 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.101953 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102107 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102252 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102408 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102556 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102717 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.102862 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103007 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103152 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103338 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103487 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103641 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103789 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.103934 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104086 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104232 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104381 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104537 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104683 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104828 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.104974 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105127 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105279 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105435 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105609 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105759 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.105907 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106054 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106222 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106372 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106518 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106667 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106841 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.106990 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107146 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107313 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107484 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107675 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107844 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.107996 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108155 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108316 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108467 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108618 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108768 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.108918 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109147 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109298 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109455 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109629 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109779 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.109937 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110088 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110240 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110398 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110544 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110688 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110842 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.110993 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111139 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111283 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111427 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111572 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111724 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.111868 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112023 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112176 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112333 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112479 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112633 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112786 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.112931 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113076 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113230 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113412 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113636 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113789 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.113936 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114083 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114247 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114406 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114553 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114700 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.114856 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115005 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115152 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115309 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115455 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115602 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115756 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.115910 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116063 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116223 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116380 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116527 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116674 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.116835 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117021 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117169 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117318 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117476 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117666 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.117867 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118047 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118198 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118355 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118507 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118657 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118806 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.118967 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119118 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119268 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119426 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119577 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119727 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.119887 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120048 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120206 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120368 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120523 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120683 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.120872 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121021 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121170 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121328 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121484 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121716 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.121879 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122024 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122169 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122320 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122475 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122632 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122778 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.122931 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123075 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123221 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123366 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123534 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123692 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123841 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.123986 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124131 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124294 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124447 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124599 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124753 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.124908 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125055 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125212 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125369 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125520 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125693 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125843 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.125991 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126152 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126307 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126454 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126601 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126748 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.126895 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127071 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127240 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127394 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127541 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127694 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.127873 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128071 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128240 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128401 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128554 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128713 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.128876 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129027 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129177 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129480 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129648 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129807 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.129966 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130114 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130268 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130419 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130565 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130719 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.130865 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131018 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131163 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131314 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131467 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131621 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131767 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.131911 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132057 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132212 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132377 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132523 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132667 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132812 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.132963 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.133116 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.133270 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.133416 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.133759 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.133925 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134074 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134221 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134390 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134539 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134687 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134842 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.134989 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135144 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135300 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135447 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135594 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135749 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.135913 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136069 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136226 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136386 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136533 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136680 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136680 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.136968 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.137126 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.137304 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.137462 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.137629 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.137786 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.138554 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.138730 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.138878 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139030 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139030 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139317 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139474 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139620 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139772 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.139917 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140066 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140221 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140367 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140513 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140664 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140816 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.140962 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141115 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141260 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141405 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141567 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141739 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.141895 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142052 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142052 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142338 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142494 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142655 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142655 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.142950 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143097 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143244 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143390 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143538 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143538 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.143855 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144030 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144188 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144338 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144487 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144648 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144810 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.144968 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145118 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145273 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145424 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145660 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145811 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.145958 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146102 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146247 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146391 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146549 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146696 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146853 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.146999 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147151 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147306 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147489 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147636 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147790 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.147935 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148099 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148277 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148424 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148576 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148738 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.148921 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149070 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149223 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149369 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149527 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149715 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.149865 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150013 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150177 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150326 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150473 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150619 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150772 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.150921 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151077 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151226 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151439 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151619 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151795 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.151970 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152121 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152272 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152421 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152570 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152720 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.152883 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.153036 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.153187 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.153335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.153486 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.153646 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.154434 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.154584 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.154731 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.154877 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155023 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155179 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155326 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155486 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155632 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155777 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.155930 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156083 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156237 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156381 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156526 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156671 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156814 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.156968 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157161 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157312 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157474 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157678 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157678 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.157970 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158119 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158284 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158450 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158598 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158754 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.158930 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159088 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159239 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159397 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159548 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159707 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.159858 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160008 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160171 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160336 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160494 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160643 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160794 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.160943 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161106 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161257 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161416 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161596 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161748 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.161934 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162094 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162242 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162390 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162544 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162691 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.162930 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163117 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163267 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163416 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163571 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163719 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.163876 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.164024 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.164181 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.164543 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.164703 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.164855 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165020 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165178 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165332 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165489 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165718 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.165879 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166034 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166189 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166482 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166636 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166793 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.166947 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167093 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167240 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167386 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167532 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167722 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.167874 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168020 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168166 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168320 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168496 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168653 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168807 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.168966 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169112 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169278 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169437 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169631 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169790 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.169940 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170087 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170237 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170393 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170542 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170696 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170845 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.170992 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171141 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171302 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171479 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171630 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171790 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.171954 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.172131 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.172295 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.172446 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.172843 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.172996 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.173146 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.173307 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.173464 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.173677 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.173875 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174034 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174183 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174338 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174485 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174650 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174819 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.174972 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175119 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175293 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175459 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175607 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175754 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.175907 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176059 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176230 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176377 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176523 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176668 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176813 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.176957 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177176 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177328 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177475 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177646 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177813 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177987 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.177987 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.178291 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.178439 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.178612 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.178770 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.178933 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179090 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179268 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179419 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179577 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179727 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.179890 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180048 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180208 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180360 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180518 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180677 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180834 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.180986 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.181134 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.181317 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.181475 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.181764 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.181914 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182080 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182254 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182408 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182555 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182710 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.182855 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183001 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183146 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183291 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183460 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183617 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183790 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.183938 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184083 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184235 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184391 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184537 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184685 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.184862 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185036 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185182 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185341 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185517 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185695 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.185855 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186011 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186159 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186325 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186474 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186622 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186770 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.186917 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187072 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187233 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187381 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187556 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187713 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.187713 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188032 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188192 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188347 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188502 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188667 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.188842 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189011 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189161 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189311 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189461 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189675 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189832 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.189988 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190142 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190302 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190455 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190609 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190757 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.190912 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191059 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191211 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191356 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191503 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191648 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191804 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.191951 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192097 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192258 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192438 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192667 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192667 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.192960 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193105 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193258 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193405 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193405 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193738 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193890 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.193890 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194171 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194334 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194493 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194648 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194648 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.194949 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195108 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195260 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195419 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195419 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195707 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.195857 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196008 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196168 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196168 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196462 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196618 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196771 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196920 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.196920 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197223 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197373 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197373 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197716 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197863 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.197863 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198197 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198351 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198498 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198651 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198651 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.198981 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199138 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199138 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199138 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199547 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199702 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199702 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.199979 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.200129 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.200129 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.200413 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201085 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201085 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201375 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201520 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201721 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201869 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.201869 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202167 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202316 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202316 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202622 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202773 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.202931 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203080 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203080 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203363 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203808 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.203955 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204108 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204257 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204405 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204566 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204761 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.204919 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.205130 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.205328 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.205482 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.205770 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.205943 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.206100 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.206390 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.206541 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.206719 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.207037 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.207190 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.207362 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.207729 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.207878 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.208099 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.208327 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.208482 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.208730 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.208912 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.209099 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.209356 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.209504 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.209684 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.209987 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.210136 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.210283 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.210597 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.210754 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.210908 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.211216 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.211364 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.211533 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.211851 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.212110 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.212263 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.212458 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.212719 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.212889 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.213075 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.213293 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.213446 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.213715 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214033 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214211 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214367 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214617 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214767 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.214963 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.215216 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.215399 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.215592 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.215834 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.215983 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.216289 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.217027 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.217178 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.217452 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.217691 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.217844 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.218102 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.218251 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.218427 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.218760 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.218919 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.219070 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.219373 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.219527 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.219719 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.219969 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.220125 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.220347 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.220564 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.220717 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.220971 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.221141 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.221306 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.221605 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.221758 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.221919 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.222214 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.222374 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.222521 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.222757 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.222922 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.223111 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.223270 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.223431 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.223678 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.223833 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224022 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224175 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224342 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224644 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224791 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.224958 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.225195 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.225360 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.225579 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.225736 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.225891 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.226141 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.226292 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.226524 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.226690 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.226863 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227020 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227174 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227461 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227611 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227829 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.227977 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.228130 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.228331 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.228496 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.228769 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.228958 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.229114 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.229278 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.229449 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.229683 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.229849 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230045 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230193 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230365 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230651 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230811 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.230972 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.231119 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.231292 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.231529 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.231680 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.231951 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.232109 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.232450 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.232596 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.232832 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233013 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233178 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233480 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233780 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.233932 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.234100 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.234266 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.234421 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.234722 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.234870 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235023 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235249 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235411 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235640 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235792 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.235971 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.236134 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.236293 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.236574 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.236723 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.236939 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.237086 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.237260 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.237445 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.237657 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.237909 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.238070 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.238218 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.238411 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.238573 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.238885 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239035 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239211 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239398 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239621 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239801 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.239953 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.240111 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.240298 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.240450 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.240720 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.240872 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241023 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241242 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241402 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241666 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241828 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.241976 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.242169 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.242322 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.242593 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.242750 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.242921 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.243105 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.243255 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.243469 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.243616 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.243872 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.244019 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.244192 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.244341 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.244510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.244752 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.245027 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.245177 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.245347 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.245635 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.245812 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246033 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246198 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246349 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246548 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246698 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.246979 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.247145 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.247299 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.247996 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.248146 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.248425 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.248574 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.248780 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.248946 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.249095 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.249336 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.249503 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.249734 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.249899 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250052 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250259 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250408 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250595 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250742 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.250899 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.251174 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.251424 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.251602 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.251761 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252072 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252229 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252409 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252570 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252742 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.252986 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.253162 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.253358 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.253510 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.253711 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.253917 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254067 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254320 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254469 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254638 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254816 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.254970 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.255246 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.255403 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.255551 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.255699 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.255879 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.256152 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.256312 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.256470 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.256727 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.256880 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.257058 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.257300 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.257467 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.257707 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.257917 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.258067 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.258313 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.258489 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.258658 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.258949 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.259107 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.259256 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.259525 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.259689 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.259875 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.260134 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.260296 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.260454 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.260738 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.261047 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.261200 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.261351 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.265614 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.265788 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.265887 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.265887 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266036 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266105 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266105 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266237 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266305 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266379 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266447 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266447 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266572 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266639 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266639 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266764 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266831 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266831 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.266947 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267012 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267085 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267153 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267296 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267372 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267372 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267499 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.267567 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268099 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268455 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268565 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268565 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268781 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.268923 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.269078 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.269224 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.269391 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.269737 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.269920 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.270067 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.270349 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.270554 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.270734 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.270928 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.271077 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.271270 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.271509 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.271668 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.271861 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.272103 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.272302 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.272486 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.272769 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.272938 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.273290 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.273446 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.273629 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.273776 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.273977 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.274170 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.274381 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.274528 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.274696 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275017 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275269 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275412 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275618 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275813 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.275956 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.276165 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.276325 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.276553 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.276754 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.276983 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.277306 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.277469 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.277719 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.277917 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.278086 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.278347 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.278545 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279337 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279337 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279511 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279586 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279655 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.279721 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280216 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280411 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280695 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280881 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.280961 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.281284 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.281638 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.281921 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.281921 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.282059 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.282188 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.282510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.282690 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.282862 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.283337 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.283454 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.283528 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.283763 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.283877 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.284106 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.284432 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.284706 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.284810 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.285209 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.285317 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.285523 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.285879 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.286030 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.286189 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.286474 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.286563 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.286830 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.287073 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.287162 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.287450 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.287660 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.287761 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.288067 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.288242 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.288378 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.288714 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.288837 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.289042 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.289356 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.289541 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.289731 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.289987 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.290140 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.290329 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.290560 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.290707 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.290952 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.291136 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.291283 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.291592 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.291744 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.291914 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.292231 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.292379 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.292555 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.292791 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.292937 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.293182 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.293335 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.293511 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.293866 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.294027 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.294200 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.294509 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.294795 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.295337 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.295511 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.295824 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.296145 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.296368 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.296711 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.296857 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.297036 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.297371 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.297536 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.297977 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.298181 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 00:50:29.298326 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.298780 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.299350 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.299942 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.300484 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.301049 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.301648 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.302200 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.302767 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.303336 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.303916 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.304488 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.305056 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.305658 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.306230 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.306838 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.307403 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.307970 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.308491 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.309073 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.309630 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.310739 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.311306 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.311872 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.312455 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.313020 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.313613 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.314181 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.314761 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.315323 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.315897 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.316568 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.317146 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.317753 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.318344 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.318857 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.319439 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.320043 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.320626 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.321221 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.321348 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.321880 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.322461 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.323487 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.324161 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.324756 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.325330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.326618 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.327183 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.327750 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.328321 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.328923 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.329499 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.330111 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.330693 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.331272 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.331853 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.332428 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.332982 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.333546 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.334132 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.334684 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.335273 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.336025 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.336621 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.337213 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.337895 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.338480 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.339055 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.339631 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.340199 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.340746 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.341359 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.341980 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.342550 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.343124 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.343914 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.344499 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.345095 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.345717 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.346302 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.346898 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.347506 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.348068 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.348619 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.349201 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.349812 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.350448 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.351054 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.351658 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.352225 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.352797 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.353363 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.353964 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.354579 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.355197 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.355775 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.356348 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.356944 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.357538 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.358110 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.358706 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.359304 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.359892 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.360468 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.361080 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.361685 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.362270 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.362849 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.363429 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.364002 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.364535 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.365138 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.365734 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.366295 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.366897 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.367501 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.368095 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.368679 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.369258 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.369899 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.370485 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.371070 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.371647 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.372225 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.373322 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.373940 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.374505 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.375107 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.375712 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.376320 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.376961 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.377544 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.378210 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.378817 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.379396 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.379977 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.380542 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:50:29.380949 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 00:50:29.388867 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.context [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23fbd8cf-57fa-48c6-8c92-2946764f5e06(cell1) {{(pid=101857) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 00:50:29.393059 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:50:29.394705 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:50:29.395505 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:50:29.397447 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:50:29.407941 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.409153 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.422228 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_db.sqlalchemy.engines [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.489989 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.context [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23fbd8cf-57fa-48c6-8c92-2946764f5e06(cell1) {{(pid=101858) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 00:50:29.494232 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:50:29.495858 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:50:29.496687 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:50:29.499189 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:50:29.514067 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_db.sqlalchemy.engines [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.516854 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_db.sqlalchemy.engines [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.572601 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.683907 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_db.sqlalchemy.engines [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:50:29.928239 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:50:29.935555 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:50:30.014823 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: WARNING keystonemiddleware.auth_token [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:50:30.022065 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: WARNING keystonemiddleware.auth_token [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:50:30.282723 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:50:30.288275 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:50:30.293848 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55620d42e9c0 pid: 101857 (default app) Jan 19 00:50:30.296848 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:50:30.298437 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002465 Jan 19 00:50:30.299633 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Wed Jan 19 00:50:30 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:50:30.376717 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: WARNING keystonemiddleware.auth_token [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:50:30.382024 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: WARNING keystonemiddleware.auth_token [None req-83618a7f-448b-4364-b5eb-b719bd3cc0ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:50:30.387427 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55620d42e9c0 pid: 101858 (default app) Jan 19 00:51:58.999085 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:51:59.000104 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 19 00:51:59.000510 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:51:59.456523 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-8fbd8c1d-8ab3-44cf-9d72-6922f53d7d25 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:51:59.487261 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-8fbd8c1d-8ab3-44cf-9d72-6922f53d7d25 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479154 Jan 19 00:51:59.488009 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1291 bytes} [Wed Jan 19 00:51:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:52:01.822929 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:01.824022 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-eec43eae-4df1-4f94-af34-93f7bcfdd0cd None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jan 19 00:52:01.824698 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:01.902799 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-a2f0ffb1-377f-4fbe-8ac6-8ab43afa0348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 256, "id": "c1", "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:01.937334 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:52:01.937334 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:52:01.988698 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-a2f0ffb1-377f-4fbe-8ac6-8ab43afa0348 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.153018 Jan 19 00:52:01.990040 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:02.446631 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-55c0d93e-78ab-47cb-9a28-6a151fccee2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:02.451335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:52:02.451335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: warnings.warn(msg) Jan 19 00:52:02.539992 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-55c0d93e-78ab-47cb-9a28-6a151fccee2b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.536082 Jan 19 00:52:02.542426 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1335 bytes} [Wed Jan 19 00:52:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:04.927468 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-a2f0ffb1-377f-4fbe-8ac6-8ab43afa0348 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:04.930549 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-a2f0ffb1-377f-4fbe-8ac6-8ab43afa0348 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003451 Jan 19 00:52:04.931396 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:05.075406 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-f07042e7-e836-46d5-85b2-15b61684802f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:05.095544 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:52:05.095544 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: warnings.warn(msg) Jan 19 00:52:05.117156 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-f07042e7-e836-46d5-85b2-15b61684802f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.178490 Jan 19 00:52:05.118066 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:05.131241 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-e4ab0e00-2fe6-45e9-a6b1-0e5c462c04cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:05.132794 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:52:05.132794 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:52:05.170737 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-e4ab0e00-2fe6-45e9-a6b1-0e5c462c04cf admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044154 Jan 19 00:52:05.171316 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1335 bytes} [Wed Jan 19 00:52:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:52:07.460832 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-f07042e7-e836-46d5-85b2-15b61684802f admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:07.461895 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-f07042e7-e836-46d5-85b2-15b61684802f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 19 00:52:07.462307 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:52:07.525407 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f33d3d70-c095-425e-9fc1-fa2f2fadacf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "ram": 1024}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:07.548848 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f33d3d70-c095-425e-9fc1-fa2f2fadacf6 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079501 Jan 19 00:52:07.549706 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:07.562086 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-4f313eca-2114-4961-8264-ddedbb5ef961 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:07.591228 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-4f313eca-2114-4961-8264-ddedbb5ef961 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032628 Jan 19 00:52:07.601806 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1335 bytes} [Wed Jan 19 00:52:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:52:09.877410 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f33d3d70-c095-425e-9fc1-fa2f2fadacf6 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:09.878841 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f33d3d70-c095-425e-9fc1-fa2f2fadacf6 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jan 19 00:52:09.879150 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:09.941344 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-cf2d4a04-bc79-4f1a-8b31-dd441ae58b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:09.959433 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-cf2d4a04-bc79-4f1a-8b31-dd441ae58b75 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074050 Jan 19 00:52:09.960001 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:09.972167 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-955b49f4-bacf-45c6-a813-3323d08ecc2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:09.999876 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-955b49f4-bacf-45c6-a813-3323d08ecc2b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031283 Jan 19 00:52:10.001177 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1335 bytes} [Wed Jan 19 00:52:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:12.342123 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-cf2d4a04-bc79-4f1a-8b31-dd441ae58b75 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:12.343128 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-cf2d4a04-bc79-4f1a-8b31-dd441ae58b75 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jan 19 00:52:12.343524 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:52:12.405330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:12.425616 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075512 Jan 19 00:52:12.426280 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:12.439424 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7c77c3b2-8725-4b7e-931f-1f59397aff57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:12.464259 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7c77c3b2-8725-4b7e-931f-1f59397aff57 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028635 Jan 19 00:52:12.469236 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1335 bytes} [Wed Jan 19 00:52:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:14.909716 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:14.911573 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Jan 19 00:52:14.912222 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:14.981103 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-8530a94b-7ebd-492f-800d-db6f9b8d65e0 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:15.005280 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-8530a94b-7ebd-492f-800d-db6f9b8d65e0 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085768 Jan 19 00:52:15.011495 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1291 bytes} [Wed Jan 19 00:52:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:17.564856 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:17.566696 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f0fba5be-1638-48bc-90e1-1c04f3e68896 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002563 Jan 19 00:52:17.567736 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:17.660963 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-fe5076b0-5d85-4cda-be36-7b3781ac8ae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:17.688407 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-fe5076b0-5d85-4cda-be36-7b3781ac8ae4 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.113150 Jan 19 00:52:17.689033 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 00:52:17.706054 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-9267e867-1fe6-4db0-93f5-4197e821f830 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:17.749694 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-9267e867-1fe6-4db0-93f5-4197e821f830 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050934 Jan 19 00:52:17.750625 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1332 bytes} [Wed Jan 19 00:52:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:52:20.222317 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-fe5076b0-5d85-4cda-be36-7b3781ac8ae4 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:20.223531 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-fe5076b0-5d85-4cda-be36-7b3781ac8ae4 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jan 19 00:52:20.223961 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:20.295477 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fbafd2cf-dee9-4f1e-99e8-e74e2e329c47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "id": "2", "vcpus": 1}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:20.316910 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fbafd2cf-dee9-4f1e-99e8-e74e2e329c47 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086145 Jan 19 00:52:20.317474 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 00:52:20.330369 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-9ddcc01a-1465-407a-aa32-5c61ab884dc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:20.355137 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-9ddcc01a-1465-407a-aa32-5c61ab884dc3 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028601 Jan 19 00:52:20.355763 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1332 bytes} [Wed Jan 19 00:52:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:22.689049 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fbafd2cf-dee9-4f1e-99e8-e74e2e329c47 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:22.690133 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fbafd2cf-dee9-4f1e-99e8-e74e2e329c47 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jan 19 00:52:22.690540 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:22.775583 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-bd345211-b91d-4e62-8953-052b7e672274 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:22.800318 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-bd345211-b91d-4e62-8953-052b7e672274 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.103368 Jan 19 00:52:22.821646 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:22.822909 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-67aa2122-3733-4879-9fa1-b36bc678a71b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:22.851644 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-67aa2122-3733-4879-9fa1-b36bc678a71b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037570 Jan 19 00:52:22.852437 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1332 bytes} [Wed Jan 19 00:52:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:25.157503 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-bd345211-b91d-4e62-8953-052b7e672274 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:25.159305 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-bd345211-b91d-4e62-8953-052b7e672274 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jan 19 00:52:25.159305 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:52:25.245823 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-ae11eb9a-e563-4341-8c5b-7ba439438deb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:25.274223 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-ae11eb9a-e563-4341-8c5b-7ba439438deb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.105257 Jan 19 00:52:25.275147 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:25.291758 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-c46a4450-cede-4cf1-a1e0-6c790f889ff0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:25.318261 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-c46a4450-cede-4cf1-a1e0-6c790f889ff0 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034808 Jan 19 00:52:25.333794 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1332 bytes} [Wed Jan 19 00:52:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:52:27.709418 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-ae11eb9a-e563-4341-8c5b-7ba439438deb admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:27.711196 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-ae11eb9a-e563-4341-8c5b-7ba439438deb admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001941 Jan 19 00:52:27.712129 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:27.776210 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:27.797335 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078583 Jan 19 00:52:27.805273 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1282 bytes} [Wed Jan 19 00:52:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:27.810876 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-cf0f95dc-e9d2-495f-8371-724af8390bc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:27.846697 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-cf0f95dc-e9d2-495f-8371-724af8390bc9 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039594 Jan 19 00:52:27.847789 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1332 bytes} [Wed Jan 19 00:52:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:52:50.770939 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:50.771974 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jan 19 00:52:50.772405 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:52:50.834837 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-465f9419-5c77-4635-83e4-b309b88e4568 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:50.852579 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-465f9419-5c77-4635-83e4-b309b88e4568 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073244 Jan 19 00:52:50.853686 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1291 bytes} [Wed Jan 19 00:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:52.255870 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:52.256879 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-01c951c9-05f5-4098-837c-16bc45870c26 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jan 19 00:52:52.257282 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:52.476252 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-7e4b54fc-717c-4126-a4b9-00f9482fe25d admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:52.482029 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.wsgi [None req-7e4b54fc-717c-4126-a4b9-00f9482fe25d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 00:52:52.482848 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-7e4b54fc-717c-4126-a4b9-00f9482fe25d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:52.483941 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-7e4b54fc-717c-4126-a4b9-00f9482fe25d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070698 Jan 19 00:52:52.484484 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1190 bytes} [Wed Jan 19 00:52:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 00:52:52.494733 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-38bd65a0-ad20-4f6d-a319-8a64fba49813 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:52.515650 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-38bd65a0-ad20-4f6d-a319-8a64fba49813 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024976 Jan 19 00:52:52.516218 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 00:52:52.526797 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-43823872-de07-40fc-9667-1ad77ebacfc3 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:52.548664 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-43823872-de07-40fc-9667-1ad77ebacfc3 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025879 Jan 19 00:52:52.549239 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:52.559331 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-0c92f528-162f-43fe-9e95-d4a75d3181bc admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:52.564905 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-0c92f528-162f-43fe-9e95-d4a75d3181bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 00:52:52.565466 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-0c92f528-162f-43fe-9e95-d4a75d3181bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:52.566283 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-0c92f528-162f-43fe-9e95-d4a75d3181bc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011101 Jan 19 00:52:52.566787 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1190 bytes} [Wed Jan 19 00:52:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 00:52:53.859789 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-43823872-de07-40fc-9667-1ad77ebacfc3 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:53.860808 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-43823872-de07-40fc-9667-1ad77ebacfc3 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 19 00:52:53.861207 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:54.066740 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-1a175783-992f-4d98-860a-76671ce70643 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:54.073020 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-1a175783-992f-4d98-860a-76671ce70643 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 00:52:54.073639 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-1a175783-992f-4d98-860a-76671ce70643 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:54.074460 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-1a175783-992f-4d98-860a-76671ce70643 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068604 Jan 19 00:52:54.075011 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1190 bytes} [Wed Jan 19 00:52:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 00:52:54.084792 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-d7cc3937-2ee1-4f55-94b4-4dfae9a32197 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:54.099497 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-d7cc3937-2ee1-4f55-94b4-4dfae9a32197 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018183 Jan 19 00:52:54.100068 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 00:52:54.111248 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-3cb37f18-429f-49e2-a52b-8dceff396234 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:54.125436 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-3cb37f18-429f-49e2-a52b-8dceff396234 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jan 19 00:52:54.126044 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:54.135671 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-d8931284-47a3-4eaa-980c-ce10b98eda47 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:54.141159 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.wsgi [None req-d8931284-47a3-4eaa-980c-ce10b98eda47 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 00:52:54.141770 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-d8931284-47a3-4eaa-980c-ce10b98eda47 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:54.142580 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-d8931284-47a3-4eaa-980c-ce10b98eda47 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010510 Jan 19 00:52:54.143115 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1190 bytes} [Wed Jan 19 00:52:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 00:52:55.427208 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-3cb37f18-429f-49e2-a52b-8dceff396234 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:55.428463 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-3cb37f18-429f-49e2-a52b-8dceff396234 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 19 00:52:55.429130 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:55.622812 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-da01de31-f4b7-4f0f-98cc-fa474304074d admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:55.628123 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.wsgi [None req-da01de31-f4b7-4f0f-98cc-fa474304074d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 00:52:55.628728 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-da01de31-f4b7-4f0f-98cc-fa474304074d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:55.629892 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-da01de31-f4b7-4f0f-98cc-fa474304074d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060085 Jan 19 00:52:55.630475 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:52:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 00:52:55.640142 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-dc8a3e4b-d70c-42ca-949e-ff0b8d5ac0ac admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:55.655436 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-dc8a3e4b-d70c-42ca-949e-ff0b8d5ac0ac admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018760 Jan 19 00:52:55.655998 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:55.667027 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:55.680712 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018205 Jan 19 00:52:55.681322 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1210 bytes} [Wed Jan 19 00:52:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:52:55.691229 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-89629af9-d30f-4c6d-b9a6-63c56cc478bc admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:55.697112 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-89629af9-d30f-4c6d-b9a6-63c56cc478bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 00:52:55.697743 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-89629af9-d30f-4c6d-b9a6-63c56cc478bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:52:55.698583 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-89629af9-d30f-4c6d-b9a6-63c56cc478bc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011127 Jan 19 00:52:55.699166 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:52:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 00:52:57.013879 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:57.014877 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jan 19 00:52:57.015266 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:57.215122 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-87606369-5b7b-49f5-978c-e532498a815a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:57.235496 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-87606369-5b7b-49f5-978c-e532498a815a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076588 Jan 19 00:52:57.236080 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1235 bytes} [Wed Jan 19 00:52:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:52:58.532751 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:52:58.534076 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jan 19 00:52:58.534565 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:52:58.738963 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-c90afbd2-832e-460c-a3d0-1a2616b28885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:52:58.757490 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-c90afbd2-832e-460c-a3d0-1a2616b28885 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077495 Jan 19 00:52:58.758092 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1235 bytes} [Wed Jan 19 00:52:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:53:00.058738 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:00.059748 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 19 00:53:00.060146 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:53:00.267667 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-95560d43-dd15-4bb4-9a7d-2321fa44336c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:53:00.294814 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-95560d43-dd15-4bb4-9a7d-2321fa44336c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086205 Jan 19 00:53:00.295369 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1235 bytes} [Wed Jan 19 00:53:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:53:01.616280 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:01.617613 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jan 19 00:53:01.618314 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:53:01.815648 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-a2236795-f35e-48ea-b7a6-ea55c29ef521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:53:01.835152 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-a2236795-f35e-48ea-b7a6-ea55c29ef521 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073107 Jan 19 00:53:01.835586 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1235 bytes} [Wed Jan 19 00:53:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:53:03.137942 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:03.138946 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 19 00:53:03.139344 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:53:03.333383 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7407199c-1178-4153-a79d-b1d18e09b8b4 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:03.352446 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7407199c-1178-4153-a79d-b1d18e09b8b4 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072207 Jan 19 00:53:03.352973 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1202 bytes} [Wed Jan 19 00:53:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:53:50.055921 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.056983 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-fe4eca6d-c284-499a-887d-28099f3a979e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jan 19 00:53:50.057379 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 930 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:53:50.115689 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2285cea2-65ff-44ab-9ee4-1d7b2b0c0f0b admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.135989 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2285cea2-65ff-44ab-9ee4-1d7b2b0c0f0b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072569 Jan 19 00:53:50.136532 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1291 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:53:50.158556 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-adee84c6-0454-43b4-9745-8bd895bcae6e admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.166378 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-adee84c6-0454-43b4-9745-8bd895bcae6e admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011355 Jan 19 00:53:50.166911 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1282 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:53:50.178942 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7c1d6e84-9d48-41cd-a746-0cb7dd22e93f admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.186569 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7c1d6e84-9d48-41cd-a746-0cb7dd22e93f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Jan 19 00:53:50.187076 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1285 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:53:50.198775 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-8bad7dd6-8d97-46ef-9e1f-1262a5381d6d admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.206580 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-8bad7dd6-8d97-46ef-9e1f-1262a5381d6d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011923 Jan 19 00:53:50.207109 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1285 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:53:50.218923 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:53:50.226692 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011252 Jan 19 00:53:50.227209 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1282 bytes} [Wed Jan 19 00:53:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:55:22.131978 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-0d02fa95-5905-4724-8403-6aa1b523d8c0 tempest-verify_tempest_config-1717392042 tempest-verify_tempest_config-1717392042-project] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:55:22.133984 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-0d02fa95-5905-4724-8403-6aa1b523d8c0 tempest-verify_tempest_config-1717392042 tempest-verify_tempest_config-1717392042-project] 10.222.0.35 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106022 Jan 19 00:55:22.134528 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1133 bytes} [Wed Jan 19 00:55:22 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:56:52.662584 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:56:52.663643 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jan 19 00:56:52.664032 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:56:52.913733 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:56:52.914901 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:56:52.914901 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:56:52.916440 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:56:52.916880 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:56:52.917709 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:56:52.918172 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:56:52.950493 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-10a2e429-5dba-4f9e-9a1c-73ae5129f69b admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.146157 Jan 19 00:56:52.951047 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 35/71] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:56:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:56:54.233105 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:56:54.234212 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jan 19 00:56:54.234607 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:56:54.428292 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:56:54.429546 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:56:54.429546 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:56:54.431147 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:56:54.431582 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:56:54.432384 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:56:54.432791 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:56:54.451847 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-0f4b2d7b-d432-4573-a795-5b37b76f1921 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075495 Jan 19 00:56:54.452330 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 36/73] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:56:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:57:06.189532 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:57:06.190541 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 19 00:57:06.190924 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 38/74] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:57:06.384999 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:57:06.386194 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:57:06.386194 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:57:06.387691 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:57:06.388126 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:57:06.388906 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:57:06.389324 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:57:06.414596 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-7bc672c4-265c-4307-9578-4e7d7143cef1 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080806 Jan 19 00:57:06.415071 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 37/75] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:57:06 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:57:07.690109 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:57:07.691103 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-089cfb9e-7f3b-4da5-a848-32d9cbf2f365 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jan 19 00:57:07.691499 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 39/76] 10.222.0.35 () {56 vars in 1074 bytes} [Wed Jan 19 00:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:57:07.883462 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG nova.api.openstack.wsgi [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] Calling method '>' {{(pid=101858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:57:07.884637 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:57:07.884637 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: warnings.warn(msg) Jan 19 00:57:07.886201 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:57:07.886639 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:57:07.887425 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:57:07.887848 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: DEBUG oslo_concurrency.lockutils [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:57:07.909012 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: INFO nova.api.openstack.requestlog [None req-f0b9ac82-2760-49c1-8ff4-d1afc45214ba admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077516 Jan 19 00:57:07.909492 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: [pid: 101858|app: 0|req: 38/77] 10.222.0.35 () {60 vars in 1193 bytes} [Wed Jan 19 00:57:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:58:06.406875 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: Wed Jan 19 00:58:06 2022 - graceful shutdown triggered... Jan 19 00:58:06.407426 dv-cinder-799871-14-iscsi devstack@n-api.service[101857]: Gracefully killing worker 1 (pid: 101857)... Jan 19 00:58:06.407001 dv-cinder-799871-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 19 00:58:06.408253 dv-cinder-799871-14-iscsi devstack@n-api.service[101858]: Gracefully killing worker 2 (pid: 101858)... Jan 19 00:58:07.408008 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: worker 1 buried after 1 seconds Jan 19 00:58:07.408008 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: worker 2 buried after 1 seconds Jan 19 00:58:07.408008 dv-cinder-799871-14-iscsi devstack@n-api.service[101856]: goodbye to uWSGI. Jan 19 00:58:07.409748 dv-cinder-799871-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 19 00:58:07.410292 dv-cinder-799871-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 19 00:58:07.412993 dv-cinder-799871-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 00:58:07.422675 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 00:58:07 2022] *** Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: nodename: dv-cinder-799871-14-iscsi Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: machine: x86_64 Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: clock source: unix Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: pcre jit disabled Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: detected number of CPU cores: 4 Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: current working directory: / Jan 19 00:58:07.424668 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: detected binary path: /usr/bin/uwsgi-core Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: your processes number limit is 47680 Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: your memory page size is 4096 bytes Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: detected max file descriptor number: 2048 Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: lock engine: pthread robust mutexes Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: thunder lock: enabled Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 00:58:07.425586 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 00:58:07.470446 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: Python main interpreter initialized at 0x5567008729c0 Jan 19 00:58:07.470446 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: python threads support enabled Jan 19 00:58:07.470446 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: your server socket listen backlog is limited to 100 connections Jan 19 00:58:07.470446 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: your mercy for graceful operations on workers is 90 seconds Jan 19 00:58:07.470897 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 00:58:07.470897 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: *** Operational MODE: preforking *** Jan 19 00:58:07.471149 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: *** uWSGI is running in multiple interpreter mode *** Jan 19 00:58:07.471149 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: spawned uWSGI master process (pid: 116531) Jan 19 00:58:07.471351 dv-cinder-799871-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 00:58:07.473605 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: spawned uWSGI worker 1 (pid: 116543, cores: 1) Jan 19 00:58:07.473605 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: spawned uWSGI worker 2 (pid: 116545, cores: 1) Jan 19 00:58:07.473605 dv-cinder-799871-14-iscsi devstack@n-api.service[116531]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 00:58:09.419680 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:58:09.419680 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: from cryptography.utils import int_from_bytes Jan 19 00:58:09.420390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:58:09.420390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: from cryptography.utils import int_from_bytes Jan 19 00:58:09.435086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:58:09.435086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: from cryptography.utils import int_from_bytes Jan 19 00:58:09.435086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 00:58:09.435086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: from cryptography.utils import int_from_bytes Jan 19 00:58:11.824354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 00:58:11.825223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 00:58:11.825726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 00:58:11.826115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 00:58:11.826367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 00:58:11.826760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.827094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.827422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.827748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.828082 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.828398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.828730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.829054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.829386 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.829673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.830000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.830329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-14-iscsi {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.830658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.830981 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.831288 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.831612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.831924 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.832251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.832560 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.833072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.834525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.834525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.834525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.834525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.834837 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-14-iscsi {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.837723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.838224 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.838301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.839555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.839555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.839555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.839799 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.839992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.841952 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.842220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.842874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.842874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.843138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.843452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.843707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.844023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.844351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.844677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.845004 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.845261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.845521 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.845887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.846216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.846535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.846852 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.847163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.847478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.847793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.848105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.848418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.848737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.849062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.849384 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.849743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.850077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.850369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.850779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.851040 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.851358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.851736 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.852063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.852378 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.852702 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.853029 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.853345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.853699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.854017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.854346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.854688 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.855008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.855269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.855562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.855877 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.856203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.856519 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.856833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.857145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.857453 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.857788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.858102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.858414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.858733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.859046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.859356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.859670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.859982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.860296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.860618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.860942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.861255 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.861585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.861897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.862211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.862538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.862850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.863189 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.863489 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.863800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.864110 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.864431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.864744 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.865054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.865379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.865790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.866077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.866672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.866840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.866991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.867327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.867642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.868007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.868261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.868425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 00:58:11.869042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.869205 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 00:58:11.869357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.869500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 00:58:11.869712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.869712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.870008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 00:58:11.870008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 00:58:11.870296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.870296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.870602 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.870755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.870913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871208 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871492 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.871798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.871947 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.872201 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.872373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.872526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.872678 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.872822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.872965 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.873108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.873256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.873399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.873588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.873740 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.873894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.874048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-14-iscsi {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.874201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.874356 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.874510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.874654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.874804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.874949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.875090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.875240 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.875397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.875540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.875688 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.875850 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.876072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.876229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.876425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.877035 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.877217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.877387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.877697 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.877857 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.878010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.878184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.878441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.878441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.878732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.878888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.879031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.879181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.879332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.879483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.879712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.879864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.880017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.880168 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.880311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.880453 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.880608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.880769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.880913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-14-iscsi {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.881066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.881211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.881366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.881522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.881722 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.881872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.882044 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.882198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.882358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.882511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.882662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.882823 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.883465 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.883624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.883775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.883926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.884069 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.884211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.884354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.884504 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.884654 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.884796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.884939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.885082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.885241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.885399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.885575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.885725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.885878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.885878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.886262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.886422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.886574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.886574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.887371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.887371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.887702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.887702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.888108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.888260 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.888403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.888678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.888835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.888979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.889121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.889274 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.889425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.889594 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.889759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.889922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.890066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.890208 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.890352 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.890515 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.890669 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.890812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.890963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.891114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.891256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.891407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.891609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.891775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.891933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.892078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.892238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.892389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.892538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.892689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.892831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.892982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.893134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.893284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.893426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.893629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.893779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.893922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.894077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.894229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.894379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.894529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.894678 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.894828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.894984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.894984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.895260 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.895260 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.895553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.895710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.895864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.896007 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.896149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.896149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.896512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.896670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.896831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.897415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.897598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.897748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.897890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.898167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.898325 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.898479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.899349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.899502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.899646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.899798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.899942 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.900094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.900246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.900404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.900557 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.900707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.900873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.901017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.901159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.901309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.901459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.901633 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.901799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.901956 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.902110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.902261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.902411 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.902567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.902722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.902873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.903072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.903223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.903374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.903374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.903661 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.903803 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.903951 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.904094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.904237 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.904393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.904543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.904706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.904855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.905006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.905156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.905313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.905463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.905623 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.905780 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.905923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.906074 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.906230 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.906392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.906623 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.906791 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.906934 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.907102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.907736 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.907881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.908034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.908202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.908540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.908691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.908833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.908977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.909130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.909274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.909625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.909790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.909942 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.910085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.910241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.910393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.910538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.910691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.910835 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.910978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.911134 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.911289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.911439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.911595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.911745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.911908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.912062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.912213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.912357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.912499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.912650 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.912802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.912945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.913094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.913281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.913438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.913615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.913764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.913905 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.914055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.914234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.914393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.914545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.914696 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.914841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.914984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.915126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.915301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.915469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.915614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.915757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.915910 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.916072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.916419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.916601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.916838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.916988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.917131 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.917298 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 00:58:11.917971 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.918127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.918291 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.918452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.918697 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.918852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919011 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919163 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.919863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.920911 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921197 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921339 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921481 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.921979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.922893 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923193 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923478 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.923933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.924076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.924226 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.924436 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.924594 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.924775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.925258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.925401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.925544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.925720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.925863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926272 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926272 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926739 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.926986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.927144 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.927296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.927439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928177 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.928905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.929058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.929215 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.929377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.929522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.929734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.930499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.930667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.930813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.930963 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931256 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931555 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931705 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.931924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932089 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932240 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932555 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.932992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.933142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.933284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.933435 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.934711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.934881 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935041 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935208 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935653 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.935949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936090 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936822 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.936990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.937300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.937459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.937632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.938231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.938394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.938540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.938693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.938862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939261 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939562 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.939877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.940022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.940171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.940510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.940690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.940939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.941510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942020 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.942925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.943955 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944099 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.944990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.945216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.945361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.946112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.946276 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.946421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.947121 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.947363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.947522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.947676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.947834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.948420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.948582 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.948736 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.948887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949289 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.949924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950665 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950814 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.950986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.951231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.951388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.951534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.951695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.951846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952004 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952236 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952539 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.952987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953590 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953751 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.953908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.954931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955364 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955516 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.955979 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956572 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.956873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.957974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.958724 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.958941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959504 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959668 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.959988 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.960932 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.961113 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.961372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.961529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.961793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.961964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.962922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.963999 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964306 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.964936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.965909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966361 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966674 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.966999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.967150 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.967300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.967462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.967638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.967859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.968014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.968164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.968735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.968975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.969994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.970296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.970296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.970590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.970745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.970896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971221 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.971963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972581 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.972992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.973964 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974115 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974721 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.974879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.975972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976779 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.976938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.977908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.978138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.978301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.978870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979044 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979502 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.979918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980402 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980551 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.980860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.981011 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.981167 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.981317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.981466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.981726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982473 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982473 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.982936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983410 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983568 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.983882 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984322 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.984967 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985125 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985275 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.985925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986567 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986719 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.986876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.987616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.987782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.987934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.988108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.988335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.988522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.989317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.989481 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.989694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.989847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990607 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.990915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991079 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991687 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.991856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.992038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.992830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.992990 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993450 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.993938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994259 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994411 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.994871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.995959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.996905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.997198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.997347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.997495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.997731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.997891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.998050 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.998199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.998372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.998629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.998629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.999042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.999608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.999776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:11.999928 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.000077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.000433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.000845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.001000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.001150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.001300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.001497 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.001697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002469 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002637 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002837 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.002920 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003144 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003412 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003497 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003754 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.003930 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004012 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004186 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004714 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004903 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.004994 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005160 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.005984 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006156 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006328 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006604 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.006991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007530 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007612 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.007892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008880 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.008961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009154 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.009856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010299 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010397 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010550 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010704 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010863 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.010942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011461 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011770 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011917 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.011986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012054 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012131 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012203 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012704 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.012940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.013987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014306 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014694 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014912 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.014994 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.015994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016219 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016437 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016437 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.016933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017011 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017099 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017310 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017569 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017673 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.017928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.018972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.019211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.019304 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.019583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.019697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.019889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020866 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.020976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.021196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.021294 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.021508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.021904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022341 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.022994 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023559 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023660 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.023973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024525 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.024942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.025960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.026846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.026969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.026969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027133 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027581 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.027888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.028091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.028430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.028525 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.028757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.028839 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.029102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.029191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.029440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.029520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.029805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.030142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.030469 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.030768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.030857 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.031966 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.032065 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.032312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.032414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.032660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.032759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033174 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033299 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033688 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.033875 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034038 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034359 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034993 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.034993 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.035283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.035443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.035603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.035763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.035925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036224 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036695 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.036846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037036 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.037913 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.038991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.039172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.039329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.039494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.039645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.039802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.040116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.040356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.040528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.040691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.040842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041311 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041813 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.041971 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042770 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.042920 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.043980 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.044974 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.045069 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.045293 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.045398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.045649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.045864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.046932 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047577 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.047927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048025 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048263 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048364 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.048998 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.049224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.049318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.049544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050472 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050573 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050793 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.050901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051111 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051740 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.051842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052177 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.052892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.053801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.054015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.054107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.054334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.054426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.054652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.055273 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.055506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.055604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.055823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.055916 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056235 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056550 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.056871 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057125 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057450 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057573 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.057902 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058226 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058785 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.058890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059113 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059212 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.059842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060176 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060537 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.060913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.061998 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.062982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063505 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.063907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064235 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.064891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065610 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065837 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.065939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.066878 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067531 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.067868 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068088 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.068835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069739 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.069847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.070065 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.070167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.070447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.071085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.071447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.071550 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.071739 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.071844 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072115 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.072833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073167 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073487 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.073934 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074554 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074713 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.074899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075065 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075705 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.075865 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.076961 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077273 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.077993 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.078717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.078892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079688 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.079858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.080944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.081102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.081253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.081649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.081816 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.081995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082767 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.082767 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 00:58:12.083063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.083063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.083063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.083498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.083498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.083898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.084116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.084439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.084756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.085074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.085399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.085746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.086100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.086428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.086744 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.087084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.087404 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.087721 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.088039 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.088364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.088683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.088999 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.089314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.089651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.089976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.090297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.090620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.090937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.091259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.091651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.091895 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.092211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.092546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.092862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.093178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.093505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.093854 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.094192 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.094517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.094841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.095204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.095533 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.096087 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.096493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.096826 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.097173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.097517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.097909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.098233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.098551 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.098891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.099219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.099545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.099869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.100610 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.100610 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.101501 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.101501 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.101712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.101946 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.102271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.102599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.102956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.103290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.103620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.103949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.104283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.104603 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.104924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.105246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.105337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_db.sqlalchemy.engines [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.105599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.105918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.106259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.106585 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.106905 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.107354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.107682 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.108021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.108359 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.108687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.109024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.109365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.109756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.110057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.110390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.110733 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.111088 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.111429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.111769 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.112089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.112405 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.112724 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.113047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.113391 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.113761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.114094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.114431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.114758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.115095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.115806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.115806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.116075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.116406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.116734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.117083 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.117968 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.118297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.118627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.118953 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.119278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.119604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.119946 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.120287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.120611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.120957 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.121291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.121649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.121982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.122310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.122653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.122981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.123312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.123638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.123964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.124294 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.124625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.124971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.125313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.125675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.126016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.126372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.126702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.127062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.127403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.127730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.128056 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.128373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 00:58:12.128626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 00:58:12.152170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_db.sqlalchemy.engines [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.172408 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.context [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23fbd8cf-57fa-48c6-8c92-2946764f5e06(cell1) {{(pid=116545) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 00:58:12.176980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:12.178625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:12.179451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:12.181960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:12.192417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_db.sqlalchemy.engines [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.194392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_db.sqlalchemy.engines [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.219458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.context [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23fbd8cf-57fa-48c6-8c92-2946764f5e06(cell1) {{(pid=116543) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 00:58:12.223757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:12.225361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:12.226224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:12.228362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:12.238979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_db.sqlalchemy.engines [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.240898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_db.sqlalchemy.engines [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.355263 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_db.sqlalchemy.engines [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.406428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_db.sqlalchemy.engines [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 00:58:12.680245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: WARNING keystonemiddleware.auth_token [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:58:12.686737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: WARNING keystonemiddleware.auth_token [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:58:12.733606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: WARNING keystonemiddleware.auth_token [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:58:12.740683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: WARNING keystonemiddleware.auth_token [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:58:13.026322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: WARNING keystonemiddleware.auth_token [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:58:13.032165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: WARNING keystonemiddleware.auth_token [None req-a0da98e7-c78d-4330-a764-9449f9386e8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:58:13.037434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567008729c0 pid: 116545 (default app) Jan 19 00:58:13.080014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: WARNING keystonemiddleware.auth_token [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 00:58:13.085379 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: WARNING keystonemiddleware.auth_token [None req-4c57121b-3cb9-422d-89e8-8c03f103a349 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 00:58:13.091464 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567008729c0 pid: 116543 (default app) Jan 19 00:58:47.729709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f1fea490-5727-4710-9b83-e60c1b1cb46b tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Action: 'create', calling method: .version_select at 0x7f934e585dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-743858755"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:58:50.278931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f1fea490-5727-4710-9b83-e60c1b1cb46b tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.796353 Jan 19 00:58:50.280364 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1154 bytes} [Wed Jan 19 00:58:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3800 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 19 00:58:50.295933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-72d99ffe-2597-4ffc-815d-d10787ab72de tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e456940>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:50.502015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-72d99ffe-2597-4ffc-815d-d10787ab72de tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 200 len: 344 microversion: 2.1 time: 0.213009 Jan 19 00:58:50.503031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 2/2] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:58:50 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:50.913913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-222830332", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "b65e5a54-facf-4b18-9222-b125b4bfcfb3"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:58:51.438798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] validate_networks() for [('b65e5a54-facf-4b18-9222-b125b4bfcfb3', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 00:58:51.514558 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0459caa9-1f80-444f-8ecc-42d6ec5bc68c tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e456e50>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:51.640143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0459caa9-1f80-444f-8ecc-42d6ec5bc68c tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 200 len: 345 microversion: 2.1 time: 0.129184 Jan 19 00:58:51.640874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 3/3] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:58:51 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:58:51.653432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e0f0c304-9682-4c7c-baf6-6474fba1404f tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Action: 'create', calling method: .version_select at 0x7f934e467310>, body: {"snapshot": {"volume_id": "c6a3e747-79b4-4d0c-815e-c25523fefc64", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-628064516"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:58:52.040552 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e0f0c304-9682-4c7c-baf6-6474fba1404f tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.392174 Jan 19 00:58:52.041141 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 4/4] 10.222.0.35 () {60 vars in 1161 bytes} [Wed Jan 19 00:58:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:52.050946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-31dd5b57-918a-4002-aca5-42975fcb5bf2 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e467ee0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:52.295121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-31dd5b57-918a-4002-aca5-42975fcb5bf2 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 286 microversion: 2.1 time: 0.161294 Jan 19 00:58:52.295121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 5/5] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:52 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:58:52.295121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e504edcd-f6d5-4fde-8416-ecbeb94adf6e tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e467f70>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:52.456549 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e504edcd-f6d5-4fde-8416-ecbeb94adf6e tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.237894 Jan 19 00:58:52.458322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 6/6] 10.222.0.35 () {58 vars in 1139 bytes} [Wed Jan 19 00:58:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:52.469414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-38acd148-f129-463d-951d-879244e98437 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e456ee0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:52.654219 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-38acd148-f129-463d-951d-879244e98437 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 286 microversion: 2.1 time: 0.188572 Jan 19 00:58:52.659312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 7/7] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:52 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:53.669201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-40f2e106-bcac-4437-9f03-bccd0d65d272 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e46a280>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:53.746376 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-40f2e106-bcac-4437-9f03-bccd0d65d272 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 286 microversion: 2.1 time: 0.081012 Jan 19 00:58:53.746992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 8/8] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:53 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:54.053817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 00:58:54.054439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 00:58:54.056771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 00:58:54.056771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 00:58:54.057092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 00:58:54.095270 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:54.095755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:54.096626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:54.097071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:54.172000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Getting quotas for project 52e012b6c4954434bf1615ab9f45af18. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:58:54.192595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Getting quotas for user a85a1e9465524d71aab2e3a66ee89a18 and project 52e012b6c4954434bf1615ab9f45af18. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:58:54.280544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 00:58:54.284514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 00:58:54.412438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a6c5e528-ef84-4af3-a9ca-3f388039bcbb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.310086 Jan 19 00:58:54.415777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 1/9] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 00:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 00:58:54.425881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f2b46368-9642-487d-af6f-228d2e40d085 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:54.426642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f2b46368-9642-487d-af6f-228d2e40d085 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:58:54.778542 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f2b46368-9642-487d-af6f-228d2e40d085 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:58:54.802193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f2b46368-9642-487d-af6f-228d2e40d085 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1214 microversion: 2.1 time: 0.379951 Jan 19 00:58:54.803137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 9/10] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:58:54 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:58:54.820106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b6c3ef81-e5b9-41eb-9acd-b74cc25c79be tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e456ee0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:54.873608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-495552412", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32083a24-3ac7-4508-bcc6-bdda771de6e3"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:58:54.983833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] validate_networks() for [('32083a24-3ac7-4508-bcc6-bdda771de6e3', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 00:58:55.447845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b6c3ef81-e5b9-41eb-9acd-b74cc25c79be tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 286 microversion: 2.1 time: 0.643588 Jan 19 00:58:55.448707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 10/11] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:54 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 286 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:55.822234 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bbed61e0-105b-4f89-95e8-e77f74e3dafc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:55.822959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bbed61e0-105b-4f89-95e8-e77f74e3dafc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:58:55.937139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bbed61e0-105b-4f89-95e8-e77f74e3dafc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:58:55.956887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bbed61e0-105b-4f89-95e8-e77f74e3dafc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1214 microversion: 2.1 time: 0.140065 Jan 19 00:58:55.973090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 11/12] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:58:55 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:58:56.459317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-456e20cf-581d-440d-ba50-27812687d1a2 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e3c29d0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:56.525693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-456e20cf-581d-440d-ba50-27812687d1a2 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 287 microversion: 2.1 time: 0.069679 Jan 19 00:58:56.534805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 12/13] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:56 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:58:56.542714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b2d6f89a-dcf8-487f-8aa6-718056d45ad1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e3c2940>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:56.689305 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b2d6f89a-dcf8-487f-8aa6-718056d45ad1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 202 len: 0 microversion: 2.1 time: 0.152987 Jan 19 00:58:56.689948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 13/14] 10.222.0.35 () {58 vars in 1253 bytes} [Wed Jan 19 00:58:56 2022] DELETE /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 00:58:56.699092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f0aa10ae-8cd3-4d13-89e4-1ab6a0475eee tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e437ca0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:56.774367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f0aa10ae-8cd3-4d13-89e4-1ab6a0475eee tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 200 len: 286 microversion: 2.1 time: 0.078840 Jan 19 00:58:56.775384 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 14/15] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:56 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:58:56.915816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 00:58:56.915816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 00:58:56.917374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 00:58:56.918783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 00:58:56.919363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 00:58:56.941038 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:56.943180 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:56.947936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:56.950855 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:56.992833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:56.993673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:58:57.010933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:57.021775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:57.025734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:57.026534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Getting quotas for project 0d99fc8541ea44ac9fae068411d73f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:58:57.029676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:57.050227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Getting quotas for user 57ab063194724671a902d8ce8313bfc9 and project 0d99fc8541ea44ac9fae068411d73f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:58:57.093606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 00:58:57.106000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 00:58:57.293757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1757dd74-ff8d-4aaa-be21-a8a180153599 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.741358 Jan 19 00:58:57.299405 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 2/16] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 00:58:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 00:58:57.310284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a7668159-dd3e-499a-a227-2e1337133adb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:57.321970 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a7668159-dd3e-499a-a227-2e1337133adb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:58:57.744579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:58:57.765304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e193ad5c-ef97-4ade-8dd6-31737ca789ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1266 microversion: 2.1 time: 0.777570 Jan 19 00:58:57.770560 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 15/17] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:58:56 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1266 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:58:57.787556 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e2a31acf-c566-4c9a-ac71-09d5eed8a3c1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e34f9d0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:57.848768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-e2a31acf-c566-4c9a-ac71-09d5eed8a3c1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] HTTP exception thrown: Snapshot 03b3a741-4a04-4c16-b0a4-4731746e2260 could not be found. Jan 19 00:58:57.849381 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e2a31acf-c566-4c9a-ac71-09d5eed8a3c1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Returning 404 to user: Snapshot 03b3a741-4a04-4c16-b0a4-4731746e2260 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:58:57.850315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e2a31acf-c566-4c9a-ac71-09d5eed8a3c1 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260" status: 404 len: 111 microversion: 2.1 time: 0.066739 Jan 19 00:58:57.851153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 16/18] 10.222.0.35 () {58 vars in 1250 bytes} [Wed Jan 19 00:58:57 2022] GET /compute/v2.1/os-snapshots/03b3a741-4a04-4c16-b0a4-4731746e2260 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 00:58:57.862663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0cdc288f-fd6f-4012-860b-216959991fb5 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934edf33a0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:58.046435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0cdc288f-fd6f-4012-860b-216959991fb5 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 202 len: 0 microversion: 2.1 time: 0.188653 Jan 19 00:58:58.052618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 17/19] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 00:58:57 2022] DELETE /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 00:58:58.057843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2b398a2c-e4aa-4287-a624-4622215c5e99 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934e3acc10>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:58.225095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2b398a2c-e4aa-4287-a624-4622215c5e99 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 200 len: 344 microversion: 2.1 time: 0.171598 Jan 19 00:58:58.225693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 18/20] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:58:58 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:58:58.258847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a7668159-dd3e-499a-a227-2e1337133adb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:58:58.300374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a7668159-dd3e-499a-a227-2e1337133adb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1221 microversion: 2.1 time: 0.992879 Jan 19 00:58:58.302277 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 3/21] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:58:57 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1221 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:58:58.570795 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1134710198", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32083a24-3ac7-4508-bcc6-bdda771de6e3"}]}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:58:58.713599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] validate_networks() for [('32083a24-3ac7-4508-bcc6-bdda771de6e3', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 00:58:58.789622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:58.790578 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:58:58.810188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:58.811686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:58.814436 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:58:58.815900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:58:59.086667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:58:59.125378 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7bd26f38-e15d-4899-b737-b37a7dd5cc85 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1266 microversion: 2.1 time: 0.340438 Jan 19 00:58:59.129300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 4/22] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:58:58 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:58:59.248373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3eff3714-8e76-4516-9ca5-879a4add5e59 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934d2bff70>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:58:59.459765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3eff3714-8e76-4516-9ca5-879a4add5e59 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 200 len: 344 microversion: 2.1 time: 0.221017 Jan 19 00:58:59.461883 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 5/23] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:58:59 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:00.147368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:00.148231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:00.171589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:00.172050 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:00.172971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:00.173440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:00.501122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:00.537308 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a00f98a2-cd53-4528-8b68-c6e748e2d99e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1266 microversion: 2.1 time: 0.394630 Jan 19 00:59:00.559450 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 6/24] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:00 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:00.593858 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e00f0f70-ae48-4ead-987d-0216052eea10 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934d251ca0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:00.678780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-e00f0f70-ae48-4ead-987d-0216052eea10 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] HTTP exception thrown: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. Jan 19 00:59:00.680103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e00f0f70-ae48-4ead-987d-0216052eea10 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Returning 404 to user: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:59:00.681872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e00f0f70-ae48-4ead-987d-0216052eea10 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 404 len: 109 microversion: 2.1 time: 0.120205 Jan 19 00:59:00.683498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 7/25] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:59:00 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 00:59:00.699979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-795253dd-c939-48b6-8a60-014972726c24 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934edee3a0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:00.757978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-795253dd-c939-48b6-8a60-014972726c24 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] HTTP exception thrown: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. Jan 19 00:59:00.760249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-795253dd-c939-48b6-8a60-014972726c24 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Returning 404 to user: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:59:00.761204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-795253dd-c939-48b6-8a60-014972726c24 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 404 len: 109 microversion: 2.1 time: 0.067982 Jan 19 00:59:00.761961 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 8/26] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 00:59:00 2022] DELETE /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 00:59:00.773834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-22449b3e-0fdf-49ff-a56b-211c412dfa73 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Calling method '.version_select at 0x7f934d251820>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:00.825330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-22449b3e-0fdf-49ff-a56b-211c412dfa73 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] HTTP exception thrown: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. Jan 19 00:59:00.826389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-22449b3e-0fdf-49ff-a56b-211c412dfa73 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] Returning 404 to user: Volume c6a3e747-79b4-4d0c-815e-c25523fefc64 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 00:59:00.827845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-22449b3e-0fdf-49ff-a56b-211c412dfa73 tempest-VolumesSnapshotsTestJSON-1985131786 tempest-VolumesSnapshotsTestJSON-1985131786-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64" status: 404 len: 109 microversion: 2.1 time: 0.059967 Jan 19 00:59:00.833815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 9/27] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 00:59:00 2022] GET /compute/v2.1/os-volumes/c6a3e747-79b4-4d0c-815e-c25523fefc64 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 00:59:00.877750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 00:59:00.878571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 00:59:00.879507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 00:59:00.882395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 00:59:00.882627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 00:59:00.954415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:00.958767 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:00.970859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:00.981174 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:01.149351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Getting quotas for project 0d99fc8541ea44ac9fae068411d73f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:01.184939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Getting quotas for user 57ab063194724671a902d8ce8313bfc9 and project 0d99fc8541ea44ac9fae068411d73f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:01.226030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 00:59:01.239783 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 00:59:01.547204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-df3207af-faa4-4baa-9273-09c35a7f3d96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.981579 Jan 19 00:59:01.555714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 19/28] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 00:58:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 00:59:01.560032 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:01.561345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-402b33ec-4874-44b3-a2f4-032a5a506a75 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:01.561664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:01.572629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-402b33ec-4874-44b3-a2f4-032a5a506a75 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:01.594133 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:01.595354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:01.597635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:01.599259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:02.052333 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-402b33ec-4874-44b3-a2f4-032a5a506a75 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:02.064904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-402b33ec-4874-44b3-a2f4-032a5a506a75 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1222 microversion: 2.1 time: 0.506469 Jan 19 00:59:02.068881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 20/29] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:01 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1222 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:02.071432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:02.132310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-550300b2-9966-4cfc-9dfd-64783ba5f3e6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1272 microversion: 2.1 time: 0.577933 Jan 19 00:59:02.138008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 10/30] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:01 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1272 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:03.081481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:03.082164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:03.092407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:03.096785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:03.097859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:03.098459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:03.154277 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:03.155074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:03.165805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:03.168752 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:03.169888 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:03.170536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:03.418142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:03.426805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-710b7a1e-cbcb-44fe-b429-ae66216f5601 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1274 microversion: 2.1 time: 0.348989 Jan 19 00:59:03.437448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 21/31] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:03 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1274 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:03.803373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:03.813234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-19c2aaed-5750-4621-8bfd-4cdc829ca3f5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1272 microversion: 2.1 time: 0.665783 Jan 19 00:59:03.833663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 11/32] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:03 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1272 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:04.456107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:04.469171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:04.494392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:04.494947 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:04.498317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:04.502563 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:04.837899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:04.839371 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:04.852452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:04.852910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:04.858940 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:04.876738 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:04.877388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:04.878745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ab81ddc0-dbc9-4ef1-8d7d-75cdd9c81cdf tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1280 microversion: 2.1 time: 0.426574 Jan 19 00:59:04.885890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 22/33] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:04 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:05.584885 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:05.603122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c8a4b224-3d77-4881-9b80-14cbc75b49be tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1272 microversion: 2.1 time: 0.773165 Jan 19 00:59:05.604779 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 12/34] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:04 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1272 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:05.895916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:05.896532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:05.907708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:05.908175 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:05.909060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:05.909633 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:06.261478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:06.294260 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9e1fd3e3-4be8-4e6a-85e8-ec54e60e6e47 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1280 microversion: 2.1 time: 0.401824 Jan 19 00:59:06.307611 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 23/35] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:05 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1280 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:06.625076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:06.625885 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:06.641311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:06.642051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:06.644158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:06.646418 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:07.091310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:07.109311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-44b2200c-645d-4eba-803a-a70eb382f9d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1272 microversion: 2.1 time: 0.489230 Jan 19 00:59:07.112904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 13/36] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:06 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1272 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:07.321324 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:07.323474 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:07.337153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:07.337977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:07.339024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:07.339599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:07.586485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:07.600580 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ec894dd1-ea35-48a1-bc10-71969410f214 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1280 microversion: 2.1 time: 0.285404 Jan 19 00:59:07.602505 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 24/37] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:07 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:08.128967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:08.130600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:08.143014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:08.145016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:08.146836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:08.149893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:08.527243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: .version_select at 0x7f934d27a430>, body: {"keypair": {"name": "tempest-keypair-89690333"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:08.590340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:08.618330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:09.179704 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:09.196091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9eceb64c-bed5-4945-ae43-8379dcdbfc9e tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 1.064774 Jan 19 00:59:09.197308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 25/38] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:08 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:09.211119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:09.211917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:09.225229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:09.226028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:09.229018 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:09.230788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:09.307876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:09.321765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:09.367245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-589fce45-b78f-46d9-8058-4d7f49b52df1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.456414 Jan 19 00:59:09.374778 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 14/39] 10.222.0.35 () {60 vars in 1157 bytes} [Wed Jan 19 00:59:07 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:10.214092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:10.215565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:10.234003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:10.237421 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:10.238793 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:10.240317 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:10.985711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:10.994121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8139d8ba-e1b9-468f-943f-86dd64722b30 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 1.795051 Jan 19 00:59:10.997546 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 26/40] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:09 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:11.338443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:11.346640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-34668b5f-c676-4ade-a638-71f88f3052eb tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 1.136557 Jan 19 00:59:11.363103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 15/41] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:10 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:11.667855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: .version_select at 0x7f934e2cc040>, body: {"keypair": {"name": "tempest-keypair-1142668122"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:11.705018 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:11.712737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:12.009073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:12.015394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:12.016028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:12.024258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:12.038811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:12.041238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:12.043864 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:12.046777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:12.176639 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-aab70781-7b42-4f0d-b34d-2a63d2fafad5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.164616 Jan 19 00:59:12.181411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 27/42] 10.222.0.35 () {62 vars in 1198 bytes} [Wed Jan 19 00:59:11 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1169 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 00:59:12.365636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:12.366343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:12.381405 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:12.386740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:12.388015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:12.393532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:13.470423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:13.483967 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-567f06a9-0eb8-4c43-894c-90b6d654f68c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 1.473257 Jan 19 00:59:13.499622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 16/43] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:12 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:13.674227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-e13fda63-d58a-46a1-9658-40419efa469e req-5f18561e-a973-4424-88ca-0ff3f33e1fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da711fa-500f-4780-bc04-640af383023e", "tag": "bf68a0a1-6050-4a83-90d4-92d38ec2d4b5"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:13.682385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:13.682385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:13.706657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-e13fda63-d58a-46a1-9658-40419efa469e req-5f18561e-a973-4424-88ca-0ff3f33e1fd7 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:13.707350 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-e13fda63-d58a-46a1-9658-40419efa469e req-5f18561e-a973-4424-88ca-0ff3f33e1fd7 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:13.733788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-e13fda63-d58a-46a1-9658-40419efa469e req-5f18561e-a973-4424-88ca-0ff3f33e1fd7 service nova] Creating event network-changed:bf68a0a1-6050-4a83-90d4-92d38ec2d4b5 for instance 6da711fa-500f-4780-bc04-640af383023e on hv-cinder-79987 Jan 19 00:59:13.734643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-e13fda63-d58a-46a1-9658-40419efa469e req-5f18561e-a973-4424-88ca-0ff3f33e1fd7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 00:59:13.738010 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:13.738776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:13.743949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:13.744592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:13.772565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.compute.rpcapi [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 00:59:13.774064 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=116543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 00:59:13.836536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e7be9dc6-96bd-4439-a270-d00f352c91f1 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.342863 Jan 19 00:59:13.837847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 17/44] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:14.198086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:14.217852 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6342b2fe-2392-4201-99d3-7f51ab2d7efa tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 1.853721 Jan 19 00:59:14.225028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 28/45] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:12 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:14.509817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:14.511541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:14.531365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:14.531840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:14.536347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:14.537183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:15.244013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:15.250925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:15.302284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:15.302820 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:15.305303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:15.308071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:16.137301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:16.172597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-da466caa-1c40-4a13-a368-68ab050c49fc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 1.663921 Jan 19 00:59:16.179552 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 18/46] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:14 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:16.489592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-531b5a3d-295f-4435-b7df-a807061edaa5 req-75820710-55d6-4a1c-8ff5-db268be30616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e02678-2973-4080-be5a-b589dd630ec9", "tag": "1c132cd5-f5f6-4711-b7a1-f2914b638f73"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:16.491296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:16.491296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:16.510290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-531b5a3d-295f-4435-b7df-a807061edaa5 req-75820710-55d6-4a1c-8ff5-db268be30616 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:16.510756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-531b5a3d-295f-4435-b7df-a807061edaa5 req-75820710-55d6-4a1c-8ff5-db268be30616 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:16.540217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-531b5a3d-295f-4435-b7df-a807061edaa5 req-75820710-55d6-4a1c-8ff5-db268be30616 service nova] Creating event network-changed:1c132cd5-f5f6-4711-b7a1-f2914b638f73 for instance b1e02678-2973-4080-be5a-b589dd630ec9 on hv-cinder-79987 Jan 19 00:59:16.558099 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-531b5a3d-295f-4435-b7df-a807061edaa5 req-75820710-55d6-4a1c-8ff5-db268be30616 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211840 Jan 19 00:59:16.559024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 19/47] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:59:17.197148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:17.197886 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:17.211059 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:17.212913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:17.215259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:17.218110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:17.238776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:17.257473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6e196848-29d8-4182-8ae7-187334a88768 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 2.021595 Jan 19 00:59:17.268575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 29/48] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:15 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:17.978421 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:17.996124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6f0391f5-a7af-45a9-bea6-0be98a9cdd69 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.804089 Jan 19 00:59:18.013719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 20/49] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:17 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:18.291824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:18.295828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:18.312054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:18.314511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:18.317932 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:18.320478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:18.630578 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-1bed1058-37a5-42c0-b579-6a90f1b024ba req-b164fe47-acad-4cd6-9d44-4fd1e660b6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c1f091-fd00-4336-ac27-00b75a950e01", "tag": "32c13ac8-bf95-47c1-9b8f-b346eaddc840"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:18.633117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:18.633117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:18.650691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-1bed1058-37a5-42c0-b579-6a90f1b024ba req-b164fe47-acad-4cd6-9d44-4fd1e660b6dc service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:18.668930 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-1bed1058-37a5-42c0-b579-6a90f1b024ba req-b164fe47-acad-4cd6-9d44-4fd1e660b6dc service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:18.709307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-1bed1058-37a5-42c0-b579-6a90f1b024ba req-b164fe47-acad-4cd6-9d44-4fd1e660b6dc service nova] Creating event network-changed:32c13ac8-bf95-47c1-9b8f-b346eaddc840 for instance a2c1f091-fd00-4336-ac27-00b75a950e01 on hv-cinder-79987 Jan 19 00:59:18.716675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-1bed1058-37a5-42c0-b579-6a90f1b024ba req-b164fe47-acad-4cd6-9d44-4fd1e660b6dc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089767 Jan 19 00:59:18.739845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 21/50] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:18.998382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:19.009362 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a6a00aa3-e768-49ab-9b1f-ebe47fca02d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.723702 Jan 19 00:59:19.020784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 30/51] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:18 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:19.025492 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:19.026333 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:19.038367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:19.038826 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:19.039633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:19.040097 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:19.306380 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-29848690", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a69b36d3-e9c7-4bd1-806e-4931e3175337"}], "security_groups": [{"name": "tempest-securitygroup--1817247949"}], "key_name": "tempest-keypair-89690333", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:19.539266 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:19.546917 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b2554b80-7c3c-440e-aba7-d4e841f49633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.525874 Jan 19 00:59:19.556602 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 22/52] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:19 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:19.740515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] validate_networks() for [('a69b36d3-e9c7-4bd1-806e-4931e3175337', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 00:59:20.026530 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:20.027326 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:20.034864 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:20.035690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:20.036720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:20.037369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:20.289499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:20.298239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-77e08635-0aa7-41d8-8580-644f29f96d9f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.275310 Jan 19 00:59:20.299174 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 23/53] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:20 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:20.572766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:20.573407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:20.581051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:20.581509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:20.582523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:20.582970 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:20.858321 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:20.871838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1dfd79d7-e004-4eb8-b9ff-38afd468ed6a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.306432 Jan 19 00:59:20.877875 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 24/54] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:20 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:21.315932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:21.316590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:21.324228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.324870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:21.325764 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.326264 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:21.504232 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:21.514184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f5f9509f-a601-4259-b412-ef8908cfe467 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.201098 Jan 19 00:59:21.515665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 25/55] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:21 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:21.554962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 00:59:21.555525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 00:59:21.556129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 00:59:21.556807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 00:59:21.557378 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 00:59:21.567386 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.568122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:21.569291 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.572018 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:21.595973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:21.604515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:21.618801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 00:59:21.622312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 00:59:21.683592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-06778dc7-c969-421d-92df-109dbb5d1ca8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.381107 Jan 19 00:59:21.684249 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 31/56] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 00:59:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 00:59:21.694477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1ba98e38-2084-4f5f-b002-880116a6255c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:21.695098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1ba98e38-2084-4f5f-b002-880116a6255c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:21.790852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1ba98e38-2084-4f5f-b002-880116a6255c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:21.803960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1ba98e38-2084-4f5f-b002-880116a6255c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1234 microversion: 2.1 time: 0.113070 Jan 19 00:59:21.804565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 26/57] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:21 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1234 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:21.892255 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:21.893068 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:21.904483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.904934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:21.911407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:21.911980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:22.546715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:22.548744 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:22.584178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:22.587297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:22.590447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:22.594318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:22.802765 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:22.812938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0952912e-47ab-4ac3-92e1-26486f4ffed4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.925362 Jan 19 00:59:22.814073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 32/58] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:21 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:22.833849 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:22.847536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:22.855127 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:22.855350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:22.856230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:22.856742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:22.951544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:22.960587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6c58fa74-8f23-47ca-bcd6-00485154ef82 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1230 microversion: 2.1 time: 0.130972 Jan 19 00:59:22.963053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 33/59] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:22 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1230 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:23.001455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-735020696", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10a2bcb-9525-4cb7-b8dd-683cdf95f329"}], "security_groups": [{"name": "tempest-securitygroup--1614525613"}], "key_name": "tempest-keypair-1142668122", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:23.028488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:23.036139 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f7b4ac20-c7b6-433b-9a4d-0f79cb0d65f3 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.507898 Jan 19 00:59:23.038856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 27/60] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:22 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:23.177372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] validate_networks() for [('d10a2bcb-9525-4cb7-b8dd-683cdf95f329', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 00:59:23.684171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 00:59:23.684919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 00:59:23.686013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 00:59:23.686533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 00:59:23.687747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 00:59:23.704137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.704886 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:23.706254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.706920 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:23.740373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 00:59:23.746413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 00:59:23.758777 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 00:59:23.760992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 00:59:23.830207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b2bf2b06-3e1b-458e-b0d5-9a60c10aa644 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.831202 Jan 19 00:59:23.837072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:23.842654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:23.845935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 34/61] 10.222.0.35 () {62 vars in 1187 bytes} [Wed Jan 19 00:59:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 00:59:23.852864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:23.853421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:23.853544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.853931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:23.856431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.857841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:23.961357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:23.972046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:23.976348 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:23.977760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9ae16457-448b-40e9-9bbe-18942837a6f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1281 microversion: 2.20 time: 0.130025 Jan 19 00:59:23.978566 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 35/62] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:23 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1281 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:23.985391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:23.986376 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:23.996159 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.996684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:23.997623 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:23.998284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:24.096195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:24.100929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:24.108589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-606fb572-dbfa-43ea-ad12-19647672be29 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1286 microversion: 2.1 time: 0.128689 Jan 19 00:59:24.109181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 36/63] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:23 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:24.126934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:24.127846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:24.134756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1a258e62-a763-4038-b02b-0a25df2ef02d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.301713 Jan 19 00:59:24.135351 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 28/64] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:23 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:24.156513 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:24.157526 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:24.158539 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:24.159151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:24.383774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:24.392055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c92e6117-1349-457f-afd3-a025af211729 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.269106 Jan 19 00:59:24.393122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 37/65] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:24 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:24.996988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:25.000214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:25.003968 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.004596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.005622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.006072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.105281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.115018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.117278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.118718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f5960ca8-e9fc-4cbe-b621-84480aefbac5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1285 microversion: 2.20 time: 0.125606 Jan 19 00:59:25.130023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 29/66] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:24 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:25.133256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:25.133904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:25.142169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.142625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.143427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.151054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.152818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:25.153918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:25.161913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.163096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.164570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.165284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.251576 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.260311 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-534f1d67-4df4-4be1-8bf7-d398f637a3b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1286 microversion: 2.1 time: 0.136924 Jan 19 00:59:25.270180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 38/67] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:25 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:25.372379 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.382490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8e3b8dd9-fd95-4970-a9c0-4bb069b208f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.234158 Jan 19 00:59:25.383775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 30/68] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:25 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:25.417334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:25.419089 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:25.425337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.425817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.426630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:25.427201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:25.583545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:25.592109 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-564d6dda-b99a-4fbe-8e92-043027054bf0 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.178599 Jan 19 00:59:25.601880 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 39/69] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:25 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:26.137831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:26.138829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:26.151944 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.152455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.153538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.154498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.277771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:26.279183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:26.294598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.298034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.301435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.302475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.317141 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.328463 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.330058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.331206 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-58f0dfdb-48ea-4e8b-a550-d3d93213525f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1333 microversion: 2.20 time: 0.198622 Jan 19 00:59:26.342624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 31/70] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:26 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1333 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:26.399720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:26.400513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:26.410981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.411540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.412417 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.422326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.425605 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.435079 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cb3c1f91-2897-41d2-8d44-f78e8a056d72 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1294 microversion: 2.1 time: 0.160733 Jan 19 00:59:26.445823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 40/71] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:26 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:26.591927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.603388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f30e099c-1338-47d2-8524-a88c1344f19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.208071 Jan 19 00:59:26.609488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:26.610397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:26.613433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 32/72] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:26 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:26.624747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.625372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.626433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:26.626867 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:26.773357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:26.782359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7ec55b51-5f7d-40ba-865c-73eaf75e7db5 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.176902 Jan 19 00:59:26.783270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 41/73] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:26 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:27.349505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:27.350216 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:27.357320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.358155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.359529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.360242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.438747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:27.448425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:27.450297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:27.451608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cb5ea950-114b-417c-abff-81e5f14c8c69 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1333 microversion: 2.20 time: 0.105956 Jan 19 00:59:27.452360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 33/74] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:27 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:27.453475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:27.454132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:27.460805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.461258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.462083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.462518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.528297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:27.535578 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-43d5bc2d-d4f0-4de7-a8eb-5e3395915dd0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1294 microversion: 2.1 time: 0.086071 Jan 19 00:59:27.536155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 42/75] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:27 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:27.632422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:27.633412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:27.639825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.640620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.641659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.642297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.798765 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:27.799478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:27.810254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.810755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.811816 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:27.812301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:27.829118 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:27.838802 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7f10d46a-fd18-421e-bec3-271519b67d46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.211981 Jan 19 00:59:27.840570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 34/76] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:27 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:28.060976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:28.071843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-926df89c-43db-4d83-9765-cd72de722539 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.276976 Jan 19 00:59:28.072445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 43/77] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:27 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:28.471158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:28.472689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:28.481422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.481907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:28.484948 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.485404 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:28.552936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:28.554432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:28.564072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.564770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:28.567034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.568303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:28.619215 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:28.630445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:28.633628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:28.635033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-66db247c-325f-490b-aa8e-341f31dfac28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1333 microversion: 2.20 time: 0.168040 Jan 19 00:59:28.636159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 35/78] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:28 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:28.666134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:28.675534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-20c7e7c3-cc8c-4c43-9dfe-a052ea233860 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1294 microversion: 2.1 time: 0.126503 Jan 19 00:59:28.686777 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 44/79] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:28 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:28.857269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:28.858762 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:28.867791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.870204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:28.883345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:28.884002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.089767 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:29.090648 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:29.106149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.107438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.110043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.111775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.280123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.294003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6d62e6b3-e13a-4227-9f36-d0cdc6aaaa09 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.440230 Jan 19 00:59:29.305796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 36/80] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:28 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:29.664918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:29.667185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:29.683889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.687147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.691063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.692258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.760132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.771995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fed72915-4c41-413c-b43f-b2e2f5f0fd01 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.685275 Jan 19 00:59:29.773292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 45/81] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:29 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:29.780271 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:29.785480 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:29.796251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.796975 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.798515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:29.799104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:29.855203 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.867891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.869668 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.872569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b176fef1-eaf4-44a7-b434-8100e993c7ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1339 microversion: 2.20 time: 0.219549 Jan 19 00:59:29.876212 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 37/82] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:29 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:29.932411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:29.961708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-81467317-56df-498c-854a-187b35eb5044 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1292 microversion: 2.1 time: 0.184495 Jan 19 00:59:29.962668 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 46/83] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:29 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1292 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:30.311783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:30.312652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:30.331480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.331903 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:30.332717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.333154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:30.773907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:30.788057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e9492788-cd03-477f-b9ac-6c785a145113 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.474986 Jan 19 00:59:30.790132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 38/84] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:30 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:30.790656 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:30.791279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:30.803194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.804216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:30.805202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.808817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:30.894684 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:30.895585 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:30.914067 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.915358 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:30.923666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:30.924818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:31.424128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:31.432037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c0757bf9-061e-458f-a40b-6016be35dabc tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.645098 Jan 19 00:59:31.432638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 47/85] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:30 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:31.464834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:31.465731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:31.480398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:31.487779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:31.488641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:31.489086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:31.650987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:31.670873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:31.678586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:31.682893 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-25d3bf1d-a013-4ed8-9144-eb701ccef994 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.792063 Jan 19 00:59:31.696817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 39/86] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:30 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:32.001746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-aeb8a92a-8e4c-4918-afbf-b6a1ee7ec0cc req-bd151638-7f2a-4604-bf19-8c0e218bfa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c1f091-fd00-4336-ac27-00b75a950e01", "name": "network-vif-plugged", "status": "completed", "tag": "32c13ac8-bf95-47c1-9b8f-b346eaddc840"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:32.003432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:32.003432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:32.016353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-aeb8a92a-8e4c-4918-afbf-b6a1ee7ec0cc req-bd151638-7f2a-4604-bf19-8c0e218bfa94 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.019962 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-aeb8a92a-8e4c-4918-afbf-b6a1ee7ec0cc req-bd151638-7f2a-4604-bf19-8c0e218bfa94 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.068329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-aeb8a92a-8e4c-4918-afbf-b6a1ee7ec0cc req-bd151638-7f2a-4604-bf19-8c0e218bfa94 service nova] Creating event network-vif-plugged:32c13ac8-bf95-47c1-9b8f-b346eaddc840 for instance a2c1f091-fd00-4336-ac27-00b75a950e01 on hv-cinder-79987 Jan 19 00:59:32.081175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-aeb8a92a-8e4c-4918-afbf-b6a1ee7ec0cc req-bd151638-7f2a-4604-bf19-8c0e218bfa94 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380337 Jan 19 00:59:32.083268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 40/87] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:32.096082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:32.099555 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:32.115399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.117191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.119245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.122413 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.425834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:32.437627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cb6eab17-121a-4848-9602-e69d4bf85dcf tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.991862 Jan 19 00:59:32.448787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 48/88] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:31 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:32.461257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:32.471840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:32.492276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.494325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.495596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.496005 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:32.498306 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.508833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d92422ff-e57f-474a-9091-6e23183537f2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.421706 Jan 19 00:59:32.512031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 41/89] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:32 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:32.704713 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:32.705713 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:32.738101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.739907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:32.748152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:32.755742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.099145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:33.111305 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c3dd36a3-9ef8-4d8d-932e-19689de1d7d6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.660250 Jan 19 00:59:33.115181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 49/90] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:32 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:33.175557 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:33.187349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:33.192884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:33.196194 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ab248513-9ab2-4e19-b2aa-057a5b37dcfd tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.496205 Jan 19 00:59:33.205931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 42/91] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:32 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:33.430790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-e2d3602c-a500-47e1-b25f-4242f85d8072 req-fb556231-d81f-4210-bd69-fd0de5e86a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78e94f1-dc77-4535-8a26-e8ff5d3e7f54", "tag": "83a2ace7-080c-4dd2-88ad-7ee6cdf7db21"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:33.455342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:33.455342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 00:59:33.474250 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:33.478336 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:33.511057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.514231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.518991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.520345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.526511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-e2d3602c-a500-47e1-b25f-4242f85d8072 req-fb556231-d81f-4210-bd69-fd0de5e86a10 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.529999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-e2d3602c-a500-47e1-b25f-4242f85d8072 req-fb556231-d81f-4210-bd69-fd0de5e86a10 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.636993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-e2d3602c-a500-47e1-b25f-4242f85d8072 req-fb556231-d81f-4210-bd69-fd0de5e86a10 service nova] Creating event network-changed:83a2ace7-080c-4dd2-88ad-7ee6cdf7db21 for instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 on hv-cinder-79987 Jan 19 00:59:33.638078 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-e2d3602c-a500-47e1-b25f-4242f85d8072 req-fb556231-d81f-4210-bd69-fd0de5e86a10 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 00:59:33.641589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.642330 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.643353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.645075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.686605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.compute.rpcapi [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 00:59:33.690890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] Releasing lock "compute-rpcapi-router" {{(pid=116545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 00:59:33.753771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-07ab2b11-d824-45b8-aaeb-fe1c9faf1ec1 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346325 Jan 19 00:59:33.754375 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 50/92] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:33.760498 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:33.764495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:33.777748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.778251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.780966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:33.781894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:33.889325 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:33.922401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7308db79-9303-4dab-a567-c8ee131b88f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.457222 Jan 19 00:59:33.933138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 43/93] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:33 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:34.099422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da711fa-500f-4780-bc04-640af383023e", "name": "network-vif-plugged", "status": "completed", "tag": "bf68a0a1-6050-4a83-90d4-92d38ec2d4b5"}, {"server_uuid": "b1e02678-2973-4080-be5a-b589dd630ec9", "name": "network-vif-plugged", "status": "completed", "tag": "1c132cd5-f5f6-4711-b7a1-f2914b638f73"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:34.102164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:34.102164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:34.124743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.125189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.147066 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] Creating event network-vif-plugged:bf68a0a1-6050-4a83-90d4-92d38ec2d4b5 for instance 6da711fa-500f-4780-bc04-640af383023e on hv-cinder-79987 Jan 19 00:59:34.147950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] Creating event network-vif-plugged:1c132cd5-f5f6-4711-b7a1-f2914b638f73 for instance b1e02678-2973-4080-be5a-b589dd630ec9 on hv-cinder-79987 Jan 19 00:59:34.158243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-b5a9464b-910f-4631-a636-f658b8b4150f req-9555ee47-d948-4932-b8e2-2804b2e9e8f3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061954 Jan 19 00:59:34.160446 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 44/94] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:59:34.169512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:34.171119 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:34.181160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.182477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.186148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.186658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.330946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:34.345000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3b89c1f5-425c-45bb-820d-a389c10f9633 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1322 microversion: 2.1 time: 0.589165 Jan 19 00:59:34.358488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 51/95] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:33 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:34.391368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:34.392176 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:34.407101 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.407600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.409449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.409939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.536766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:34.546935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b9ae460b-e9f8-4f65-a209-596b094b0c1b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.385065 Jan 19 00:59:34.548631 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 45/96] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:34 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:34.873371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:34.882406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:34.884268 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:34.885516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1d4e9f36-3807-4539-97bb-acd967cd16a7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.525231 Jan 19 00:59:34.886173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 52/97] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:34 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:34.952896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:34.953568 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:34.960641 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.961237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:34.962290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:34.962809 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.125024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:35.133033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8a4ecf18-3caa-4fb2-9180-f2698dbe1ac0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.184656 Jan 19 00:59:35.133620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 46/98] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:34 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:35.364511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:35.366497 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:35.374099 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.374935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.376031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.377070 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.564673 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:35.565352 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:35.575583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.577112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.580970 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.582618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.785455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:35.795067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d310270a-4b43-4b09-8fc8-861a0d8da136 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1515 microversion: 2.1 time: 0.435505 Jan 19 00:59:35.796155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 53/99] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:35 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1515 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:35.817844 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:35.819316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:35.828303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.830694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.831587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.832037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.856975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:35.866624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1e2ddce4-a6c8-4b5f-ad9f-000d63fa8d5b tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.305657 Jan 19 00:59:35.875971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 47/100] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:35 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:35.901647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-ba016f6a-a840-4e44-bf44-6a60f5816219 req-bf3a983e-aa74-42c5-a7d9-1ca04344e4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:35.904628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:35.904628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:35.912619 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-ba016f6a-a840-4e44-bf44-6a60f5816219 req-bf3a983e-aa74-42c5-a7d9-1ca04344e4b8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.914026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-ba016f6a-a840-4e44-bf44-6a60f5816219 req-bf3a983e-aa74-42c5-a7d9-1ca04344e4b8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.921927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'flavor' on Instance uuid a2c1f091-fd00-4336-ac27-00b75a950e01 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 00:59:35.929102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-ba016f6a-a840-4e44-bf44-6a60f5816219 req-bf3a983e-aa74-42c5-a7d9-1ca04344e4b8 service nova] Creating event network-changed:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 00:59:35.935354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-ba016f6a-a840-4e44-bf44-6a60f5816219 req-bf3a983e-aa74-42c5-a7d9-1ca04344e4b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039981 Jan 19 00:59:35.936845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 48/101] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:59:35.944495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:35.945307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:35.951466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.952030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:35.953514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:35.958148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.121161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4eee9654-3195-48d6-9bfc-9f8f94c47fea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01/action" status: 200 len: 32 microversion: 2.1 time: 0.306512 Jan 19 00:59:36.125226 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 54/102] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:35 2022] POST /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 00:59:36.146484 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:36.149039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:36.157075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.158066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.159398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.160443 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.167928 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:36.179317 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:36.180923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:36.182566 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a5c9a58d-9674-48a6-98e1-724007529bc0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.244144 Jan 19 00:59:36.183723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 49/103] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:35 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:36.199401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:36.200431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:36.213182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.213666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.214502 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.214941 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.462114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:36.476249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-996d5612-d41c-4fbe-b676-16fb522e7087 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.290461 Jan 19 00:59:36.486843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 50/104] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:36 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:36.888285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:36.900426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:36.930412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.930412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:36.930412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:36.940618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:37.201357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.216864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-727a04b3-909c-4236-bd91-f638756be2b4 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 1.084300 Jan 19 00:59:37.230550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 55/105] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:36 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:37.246448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:37.247991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:37.258476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:37.259550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:37.261264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:37.262273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:37.410059 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.427799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3703d546-7fcf-4815-9d64-43fb4a87ce76 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1314 microversion: 2.1 time: 0.546855 Jan 19 00:59:37.428975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 51/106] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:36 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:37.498720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:37.500216 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:37.513030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:37.513890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:37.516838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:37.519758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:37.675520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.703250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.711397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.714233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-18f9fd20-8f49-4329-9627-8a47fd067091 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.480695 Jan 19 00:59:37.716466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 56/107] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:37 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:37.780730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:37.794553 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a117b01a-b697-4ade-82d8-b87d3e98c7a4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.304495 Jan 19 00:59:37.812907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 52/108] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:37 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:38.254075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:38.254887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:38.262616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.263618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.264740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.265762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.452988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:38.456806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:38.469171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.470264 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.470583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:38.471795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.473033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.488253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-28784323-a100-491b-8be7-c1615726e676 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.237702 Jan 19 00:59:38.509287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 57/109] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:38 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:38.645511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:38.666965 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dddb4cb8-e68a-457d-bb77-17f075f5b2ba tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1501 microversion: 2.1 time: 0.221019 Jan 19 00:59:38.667887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 53/110] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:38 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:38.734545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:38.735524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:38.742405 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.743187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.744117 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.744764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.827251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:38.828446 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:38.853319 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.854135 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.855725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:38.856469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:38.999584 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:39.010931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:39.012781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:39.014214 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c5e66dd0-3391-486d-93e2-a5f81a952e18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.283242 Jan 19 00:59:39.026705 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 58/111] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:38 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 00:59:39.144705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:39.173841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bcde6e7c-071d-4128-877f-8dd86cd8e2ca tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.356808 Jan 19 00:59:39.175809 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 54/112] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:38 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:39.517179 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:39.517981 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:39.525074 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:39.525523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:39.526355 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:39.526793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:39.679972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:39.688725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0a707c4b-4655-4328-a6a0-628f5644b631 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.175248 Jan 19 00:59:39.689308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 59/113] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:39 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:40.036414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:40.037357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:40.047332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.047843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.048703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.049176 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.191632 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:40.204170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:40.204359 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:40.205206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:40.207095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:40.209024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-780a33ea-7840-478a-9996-3c02811c472f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.179488 Jan 19 00:59:40.210511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 55/114] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:40 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:40.216850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.217397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.218324 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.218836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.373168 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:40.388254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0e106600-8788-4dea-bb9f-0eefa1f198b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.190524 Jan 19 00:59:40.388859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 60/115] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:40 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:40.716744 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:40.717363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:40.724060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.724440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.725827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:40.726270 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:40.867052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:40.875976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e5ab1be8-2026-488a-bbc9-f48dca5312f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.163229 Jan 19 00:59:40.876574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 56/116] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:40 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:41.228118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:41.228794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:41.234966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.235411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:41.236243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.236682 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:41.408960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:41.409631 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:41.416493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.416950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:41.417788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.418314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:41.437511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:41.452026 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:41.456370 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:41.458944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9e7ee9ce-7b2c-4b2b-aafb-6c9050886517 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.234079 Jan 19 00:59:41.460632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 61/117] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:41 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:41.589994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:41.599200 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-008e5d4b-8a07-44e6-bcfc-94f45f714a9c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.194275 Jan 19 00:59:41.599801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 57/118] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:41 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:41.893402 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:41.894039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:41.900093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.900550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:41.901329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:41.901791 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:42.197603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:42.207570 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-58c7e624-0a75-45aa-8401-a342d93d1fed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.317753 Jan 19 00:59:42.208445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 62/119] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:41 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:42.489002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:42.489932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:42.497848 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:42.498314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:42.499122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:42.499649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:42.617831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:42.619398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:42.631233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:42.633006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:42.636374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:42.637479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:42.700628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:42.717444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:42.718514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:42.719930 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-da1e1baf-6ff7-44ac-823c-ef7e7727cc33 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.235260 Jan 19 00:59:42.731306 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 58/120] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:42 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:42.885057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:42.893508 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ac9a8ff7-8528-47d3-b875-928cc38096c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.281000 Jan 19 00:59:42.894169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 63/121] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:42 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:43.226004 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:43.226772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:43.233649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.234591 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.235468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.235900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.485441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "933858b3-0632-4c5a-8078-db6a187db192"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:43.491701 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:43.501912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.502536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.503544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.503993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.530255 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:43.544206 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d1dc03ce-3635-4de9-a7c9-801acb46d12d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.322613 Jan 19 00:59:43.545975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 59/122] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:43 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:43.646578 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-d0ac9f0a-d07d-4c9c-9ed7-9eeabf367c3f req-a644589b-7e08-44df-afef-d06cbacbb49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e94f1-dc77-4535-8a26-e8ff5d3e7f54", "name": "network-vif-plugged", "status": "completed", "tag": "83a2ace7-080c-4dd2-88ad-7ee6cdf7db21"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:43.648546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:43.648546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:43.668525 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d0ac9f0a-d07d-4c9c-9ed7-9eeabf367c3f req-a644589b-7e08-44df-afef-d06cbacbb49f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.669192 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d0ac9f0a-d07d-4c9c-9ed7-9eeabf367c3f req-a644589b-7e08-44df-afef-d06cbacbb49f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.683069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-d0ac9f0a-d07d-4c9c-9ed7-9eeabf367c3f req-a644589b-7e08-44df-afef-d06cbacbb49f service nova] Creating event network-vif-plugged:83a2ace7-080c-4dd2-88ad-7ee6cdf7db21 for instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 on hv-cinder-79987 Jan 19 00:59:43.688915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-d0ac9f0a-d07d-4c9c-9ed7-9eeabf367c3f req-a644589b-7e08-44df-afef-d06cbacbb49f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047707 Jan 19 00:59:43.689932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 60/123] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:59:43.757835 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:43.759994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:43.771949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.773220 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.774817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:43.775691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:43.992710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:44.016193 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:44.018132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:44.019574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f9658c87-4f5a-4a99-8f44-87ae5f6ec7d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.270279 Jan 19 00:59:44.020664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 61/124] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:43 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 00:59:44.027803 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:44.028650 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:44.036601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:44.037387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:44.038181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:44.038615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:44.105186 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9d986cb6-1c5b-435a-9fd9-d2c153acef9a tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "POST /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628119 Jan 19 00:59:44.115454 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 64/125] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 00:59:43 2022] POST /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:44.313719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:44.326994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9cf69e87-24b3-427b-be97-7392c0e96ffd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.304569 Jan 19 00:59:44.328495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 62/126] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:44 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:44.563212 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:44.564391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:44.573217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:44.574158 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:44.575156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:44.575753 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:44.803986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:44.818229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3a220874-10e6-4b60-8d73-a622c577054e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.258766 Jan 19 00:59:44.819018 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 65/127] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:44 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:45.049599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:45.051285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:45.062406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.063237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.064715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.065601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.260528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:45.270011 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:45.271893 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:45.273712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-83abf17e-4f61-415a-bd84-49b2c8a28560 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.231889 Jan 19 00:59:45.274301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 63/128] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:45 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:45.354275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:45.354999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:45.363323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.363838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.364883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.365438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.528871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:45.537725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2add6699-d96f-4aef-80f4-57611d792a74 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1360 microversion: 2.1 time: 0.187419 Jan 19 00:59:45.538637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 66/129] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:45 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:45.726843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-921b0284-f629-40e9-8b7b-c198044fe537 req-4414c268-3ba1-4331-ad86-ea4c4713a67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "name": "network-vif-plugged", "status": "completed", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:45.731096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:45.731096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 00:59:45.745320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-921b0284-f629-40e9-8b7b-c198044fe537 req-4414c268-3ba1-4331-ad86-ea4c4713a67b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.746326 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-921b0284-f629-40e9-8b7b-c198044fe537 req-4414c268-3ba1-4331-ad86-ea4c4713a67b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.771031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-921b0284-f629-40e9-8b7b-c198044fe537 req-4414c268-3ba1-4331-ad86-ea4c4713a67b service nova] Creating event network-vif-plugged:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 00:59:45.780163 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-921b0284-f629-40e9-8b7b-c198044fe537 req-4414c268-3ba1-4331-ad86-ea4c4713a67b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061597 Jan 19 00:59:45.780870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 64/130] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:45.856681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:45.858027 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:45.872469 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.873146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:45.874725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:45.875750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.102870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:46.114392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2c98559f-9530-4f8d-b28f-f94b522ab19b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.268907 Jan 19 00:59:46.118818 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 67/131] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:45 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:46.316070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:46.317750 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:46.336962 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.338658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.340679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.341833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.557882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:46.558715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:46.567840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.574906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.576808 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.578203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.661995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:46.679850 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:46.683510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:46.686022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-79c75b27-0845-439d-8c7c-9f5bc272b347 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.383406 Jan 19 00:59:46.699874 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 65/132] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:46 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:46.784424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:46.803755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e9d471bd-e70e-4fb1-b0fa-8444106873dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1545 microversion: 2.1 time: 0.247380 Jan 19 00:59:46.805204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 68/133] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:46 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1545 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:46.830160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:46.831164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:46.840216 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.841017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:46.842147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:46.843161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:47.047188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-21fb7bab-1061-4cdf-bfa1-b7d466896360 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223244 Jan 19 00:59:47.049273 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 66/134] 10.222.0.35 () {58 vars in 1274 bytes} [Wed Jan 19 00:59:46 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:47.145344 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:47.146227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:47.158500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:47.159500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:47.160941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:47.161875 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:47.467669 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:47.480682 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-83c8bb11-1c11-4273-b48d-5f685d28beda tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.341591 Jan 19 00:59:47.481726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 69/135] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:47 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:47.716176 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:47.717834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:47.742652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:47.747184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:47.750544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:47.752355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:48.474249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:48.489165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:48.505761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:48.508043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:48.509835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:48.514285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3a93d80a-67f7-474d-bcc1-f4f1a626228d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1407 microversion: 2.20 time: 0.801593 Jan 19 00:59:48.534044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 67/136] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:47 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1407 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:48.561815 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:48.562250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:48.563946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:48.564555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.026858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:49.045473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fea7a561-da98-40ee-bdac-6fb429d5750e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.547538 Jan 19 00:59:49.046606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 70/137] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:48 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:49.561647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:49.563915 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ea0914fc-1cdd-49b9-ab2f-c17677bad75e req-f5cd6ffb-bdea-4ac8-944c-3b1ad7b0b09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78e94f1-dc77-4535-8a26-e8ff5d3e7f54", "tag": "83a2ace7-080c-4dd2-88ad-7ee6cdf7db21"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:49.571771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:49.573707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:49.573707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 00:59:49.610237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:49.615535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ea0914fc-1cdd-49b9-ab2f-c17677bad75e req-f5cd6ffb-bdea-4ac8-944c-3b1ad7b0b09b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:49.620541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.625718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:49.627784 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.630284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ea0914fc-1cdd-49b9-ab2f-c17677bad75e req-f5cd6ffb-bdea-4ac8-944c-3b1ad7b0b09b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.697920 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ea0914fc-1cdd-49b9-ab2f-c17677bad75e req-f5cd6ffb-bdea-4ac8-944c-3b1ad7b0b09b service nova] Creating event network-changed:83a2ace7-080c-4dd2-88ad-7ee6cdf7db21 for instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 on hv-cinder-79987 Jan 19 00:59:49.710318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ea0914fc-1cdd-49b9-ab2f-c17677bad75e req-f5cd6ffb-bdea-4ac8-944c-3b1ad7b0b09b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160673 Jan 19 00:59:49.712265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 71/138] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:49.727374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:49.728676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:49.758674 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:49.759528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.762695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:49.765833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:49.923161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d94190ae-1f6c-4991-adca-77a5129d8b13 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.389003 Jan 19 00:59:49.924309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 68/139] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:49 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 00:59:50.080112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:50.081390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:50.140917 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.147648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:50.154158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.158105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:50.626196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:50.655244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-420b8f65-8bcf-4ebd-9f16-0a4fc8d3a3ae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.581427 Jan 19 00:59:50.661181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 69/140] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:50 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:50.716748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:50.735898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:50.741967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:50.744603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-49cf5542-6de3-4410-bb58-e6595b762071 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1599 microversion: 2.20 time: 1.029838 Jan 19 00:59:50.747254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 72/141] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 00:59:49 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1599 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 00:59:50.772249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:50.773132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:50.790705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.792495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:50.795167 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.796301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:50.939874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:50.941207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:50.950957 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.951616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:50.953463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:50.954162 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:51.069738 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0406e009-df6e-4772-a4e2-3c61b42213c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.305886 Jan 19 00:59:51.070846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 70/142] 10.222.0.35 () {60 vars in 1315 bytes} [Wed Jan 19 00:59:50 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 00:59:51.091601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9ff9fb83-9d01-4050-9f8c-5b8eec764f6a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.157891 Jan 19 00:59:51.092690 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 73/143] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:50 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 00:59:51.694431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:51.700062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:51.743682 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:51.747106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:51.756178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:51.757431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:52.106429 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:52.109855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:52.124578 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:52.125266 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:52.126323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:52.126926 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:52.257844 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4a02ff90-c033-4371-8169-33778d62df33 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.156118 Jan 19 00:59:52.259014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 74/144] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:52 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 00:59:52.757876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:52.806878 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0a80028e-ee4d-4e13-b279-0883107de974 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 1.134319 Jan 19 00:59:52.808201 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 71/145] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:51 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:53.277142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:53.278588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:53.295475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.295945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.299301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.300132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.501442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5e0a911d-0e80-4c5c-895a-f2ccc59cbf35 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.235227 Jan 19 00:59:53.511151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 75/146] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:53 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 00:59:53.745430 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:53.746955 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:53.780847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ba629eb0-3a8f-4ac0-af73-c7c0864c7b0b req-4c1f4825-d527-4696-a4d8-82c5f28c232e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:53.781146 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.781636 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.782209 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.782649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.783731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:53.783731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 00:59:53.806979 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ba629eb0-3a8f-4ac0-af73-c7c0864c7b0b req-4c1f4825-d527-4696-a4d8-82c5f28c232e service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.810412 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ba629eb0-3a8f-4ac0-af73-c7c0864c7b0b req-4c1f4825-d527-4696-a4d8-82c5f28c232e service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.861175 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ba629eb0-3a8f-4ac0-af73-c7c0864c7b0b req-4c1f4825-d527-4696-a4d8-82c5f28c232e service nova] Creating event network-changed:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 00:59:53.876863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ba629eb0-3a8f-4ac0-af73-c7c0864c7b0b req-4c1f4825-d527-4696-a4d8-82c5f28c232e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101150 Jan 19 00:59:53.879575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 76/147] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 00:59:53.898504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:53.902166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:53.922961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.925775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:53.926773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:53.927232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:54.054574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9a59bc35-82f6-43b8-9959-e8ef303beb18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.312793 Jan 19 00:59:54.056644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 72/148] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 00:59:53 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 00:59:54.442653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:54.444135 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:54.453665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:54.454475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:54.455742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:54.456573 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:54.501954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 00:59:54.801789 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ec11e096-8358-4f08-81a6-4e3083f54d5f tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 204 len: 0 microversion: 2.1 time: 0.362819 Jan 19 00:59:54.805960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 73/149] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 00:59:54 2022] DELETE /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 00:59:54.822699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:54.829058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:54.855924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:54.861677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:54.866805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:54.867834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:55.044939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1c1fca21-129e-4ff5-bd5e-4a3f3f716812 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.235791 Jan 19 00:59:55.050343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 74/150] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:54 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 00:59:55.058708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:55.060089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:55.086091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:55.088990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:55.092536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:55.093163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:55.094902 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:55.119304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ffa64bfe-6e2e-4397-9eed-d42e2cac6fbb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 1.236416 Jan 19 00:59:55.120443 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 77/151] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:53 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:55.137694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:55.153713 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:55.188370 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:55.189762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:55.191679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:55.193195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:55.387931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:55.397836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-67b1cb28-5782-4d09-9d7c-295d8946d7aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.275029 Jan 19 00:59:55.402708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 78/152] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 00:59:55 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:55.406507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bd529928-d4c3-4685-ad3d-bd1411fc3ad6 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1553 microversion: 2.1 time: 0.354166 Jan 19 00:59:55.407575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 75/153] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:55 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:56.061937 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:56.064187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:56.093772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.095525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.098447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.102865 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.139609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:56.141378 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:56.156799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.159958 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.162476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.166914 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.315206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-41b8c34b-e315-4410-96dc-c143282795e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.260036 Jan 19 00:59:56.319334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 79/154] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:56 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 00:59:56.420905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:56.425320 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:56.476097 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.478218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.481172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.482425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.706658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-776ce8a5-ac34-4a9c-b0e4-c455da331a3f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.297597 Jan 19 00:59:56.711766 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 80/155] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 00:59:56 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:56.726379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:56.727919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:56.747383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.748482 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.750091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:56.750982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:56.983506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:57.002625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-505b1932-b7dd-47f7-b974-a95682b7faff tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.867454 Jan 19 00:59:57.003417 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 76/156] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:56 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:57.178121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:57.193163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3c65b870-16fd-49f5-95d2-11e7b8c29419 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1553 microversion: 2.1 time: 0.478390 Jan 19 00:59:57.194379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 81/157] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:56 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:57.332225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:57.337810 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:57.361580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:57.362483 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:57.364431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:57.365899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:57.516170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0deeae6d-1b9c-4a3e-ab6e-708219258735 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.191382 Jan 19 00:59:57.517304 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 77/158] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:57 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 00:59:57.727391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:57.730038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:57.744634 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:57.745838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:57.747462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:57.748487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:57.872836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-59be6e0a-e768-48d1-beeb-d68d0edc35e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.155387 Jan 19 00:59:57.875103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 82/159] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 00:59:57 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:58.027024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:58.028748 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:58.041092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.042062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.044925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.045677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.218987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:58.225596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:58.243024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.244219 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.250237 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.251332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.446285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:58.488164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9084e24b-f398-445f-83f1-5d661f495e86 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.465773 Jan 19 00:59:58.516092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 78/160] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:58 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:58.542390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:58.544717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:58.554487 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.555648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.556825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.557451 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.706455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-84c9fb88-412d-4452-bcb5-e6be02199c56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.178158 Jan 19 00:59:58.713807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 79/161] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:58 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 00:59:58.904896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:58.905505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:58.918963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:58.928171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.929639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.932014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:58.935042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:58.956599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7184da4f-0af8-4388-b638-47d35a923b12 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1553 microversion: 2.1 time: 0.732763 Jan 19 00:59:58.957714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 83/162] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:58 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1553 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:59.077329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7f1725b4-3fc4-4756-8400-37751960028f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.191863 Jan 19 00:59:59.083126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 80/163] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 00:59:58 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 00:59:59.202813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ef6e9414-3ccb-4ae2-b242-8eac15d71c88 req-75e733c2-b66c-48da-ab25-18c4d28549e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da711fa-500f-4780-bc04-640af383023e", "name": "network-vif-deleted", "tag": "bf68a0a1-6050-4a83-90d4-92d38ec2d4b5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:59.206062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 00:59:59.206062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 00:59:59.221523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ef6e9414-3ccb-4ae2-b242-8eac15d71c88 req-75e733c2-b66c-48da-ab25-18c4d28549e3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:59.222641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ef6e9414-3ccb-4ae2-b242-8eac15d71c88 req-75e733c2-b66c-48da-ab25-18c4d28549e3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:59.269091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ef6e9414-3ccb-4ae2-b242-8eac15d71c88 req-75e733c2-b66c-48da-ab25-18c4d28549e3 service nova] Creating event network-vif-deleted:bf68a0a1-6050-4a83-90d4-92d38ec2d4b5 for instance 6da711fa-500f-4780-bc04-640af383023e on hv-cinder-79987 Jan 19 00:59:59.296645 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ef6e9414-3ccb-4ae2-b242-8eac15d71c88 req-75e733c2-b66c-48da-ab25-18c4d28549e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097867 Jan 19 00:59:59.298700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 84/164] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 00:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 00:59:59.534564 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:59.540098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:59.570124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:59.571598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:59.573846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:59.576025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:59.728104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 00:59:59.729908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 00:59:59.772998 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:59.773935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:59.782709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 00:59:59.783738 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 00:59:59.926992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-77cc9e62-9ccb-4aeb-8660-d1e3593e28de tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.204011 Jan 19 00:59:59.933663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 85/165] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 00:59:59 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 00:59:59.979859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 00:59:59.986576 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 00:59:59.988071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:00.000234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c935d6a7-d303-4dd2-b01b-da562754f889 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.476822 Jan 19 01:00:00.001223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 81/166] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:59 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:00.008298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.009248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.011064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.011928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.062220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.070928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.071841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lazy-loading 'fault' on Instance uuid 6da711fa-500f-4780-bc04-640af383023e {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:00:00.103909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:00.105965 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:00.124480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.125869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.128622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.130627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.156985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85a1e9465524d71aab2e3a66ee89a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e012b6c4954434bf1615ab9f45af18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:00.167601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bdce9c69-2274-438f-824b-180db9c26218 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 200 len: 1350 microversion: 2.1 time: 0.189558 Jan 19 01:00:00.168466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 86/167] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 00:59:59 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 1350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:00.259129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e9254243-5f21-4564-840d-06583d97f39a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.170019 Jan 19 01:00:00.271251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 82/168] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:00 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:00.950944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:00.953778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:00.965787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.967209 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:00.968969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:00.969945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.027520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:01.034878 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:01.053841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.054956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.056543 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.057482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.113254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-77e51a18-0c32-4c0a-9846-b475adfef643 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 14 microversion: 2.1 time: 0.170374 Jan 19 01:00:01.116560 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 87/169] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:00 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:00:01.200719 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:01.202447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:01.219217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.220096 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.221706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.223472 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.270364 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] HTTP exception thrown: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. Jan 19 01:00:01.275753 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Returning 404 to user: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:01.277115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9cc8bcbf-e046-42b6-acb2-c1b1e44ebbc9 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 404 len: 111 microversion: 2.1 time: 0.084311 Jan 19 01:00:01.278341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 88/170] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:01 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:00:01.301813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:01.309160 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:01.319704 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.320599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.323156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:01.324350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:01.422887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4fb23aae-f314-4df7-a8de-d2150699a026 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.125032 Jan 19 01:00:01.424190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:01.425241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 89/171] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:01 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:01.442387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3133222c-ac8a-4396-9d9a-13e3a3496628 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.425263 Jan 19 01:00:01.443672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 83/172] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:01 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:02.131650 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:02.133691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:02.150247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:02.152230 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:02.156732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.158229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.159620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.160295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.166036 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.166510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.167446 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.167897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.200780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] HTTP exception thrown: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. Jan 19 01:00:02.201408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Returning 404 to user: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:02.202408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ce11770e-3a46-42be-a00c-490bc1f956ac tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056904 Jan 19 01:00:02.209784 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 84/173] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:00:02 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:00:02.303152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-58c665ed-7b4c-4232-b89a-954e46c72066 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 2006 microversion: 2.1 time: 0.175333 Jan 19 01:00:02.304658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 90/174] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:02 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 2006 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:02.437517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:02.438733 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:02.452746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.454301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.455289 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.456075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.465763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:02.471580 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:02.488953 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.489796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.491694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:02.501843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:02.573347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-37b22171-79bc-463b-8f5f-ae7309a3a936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 14 microversion: 2.20 time: 0.139871 Jan 19 01:00:02.575386 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 85/175] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:02 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:02.791676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:02.801499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-63b88ea7-4143-4c86-821c-e627642dcb87 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.343347 Jan 19 01:00:02.802144 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 91/176] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:02 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:03.330905 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:03.333302 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:03.343611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.344287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.345276 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.346069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.460915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-728646a5-9975-4f80-b986-c09ce68e0b2f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 10009 microversion: 2.1 time: 0.139003 Jan 19 01:00:03.462686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 86/177] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:03 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 10009 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:03.589359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:03.590961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:03.599250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.599571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.601356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.602051 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.723538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dc540bb6-4d2e-41d7-be75-2145ff0c9cf2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 3504 microversion: 2.20 time: 0.137156 Jan 19 01:00:03.725065 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 92/178] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:03 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 3504 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:00:03.815895 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:03.816658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:03.827755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.828693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.830342 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.832576 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.837853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:03.838961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:03.851604 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.851872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] HTTP exception thrown: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. Jan 19 01:00:03.852409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.852609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Returning 404 to user: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:03.853519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-09254dcc-b4c2-4064-bbf4-983c31935aed tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 404 len: 111 microversion: 2.1 time: 0.043256 Jan 19 01:00:03.853829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.854587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.857693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 87/179] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:00:03 2022] DELETE /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:00:03.862872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:03.863496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] [instance: 6da711fa-500f-4780-bc04-640af383023e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:03.872267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.872719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.874141 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:03.874640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:03.891715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] HTTP exception thrown: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. Jan 19 01:00:03.892944 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] Returning 404 to user: Instance 6da711fa-500f-4780-bc04-640af383023e could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:03.893778 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1c447a56-fdbc-44c7-9065-f7259cf57010 tempest-DeleteServersTestJSON-1913307778 tempest-DeleteServersTestJSON-1913307778-project] 10.222.0.35 "GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e" status: 404 len: 111 microversion: 2.1 time: 0.035070 Jan 19 01:00:03.894584 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 88/180] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:03 2022] GET /compute/v2.1/servers/6da711fa-500f-4780-bc04-640af383023e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:00:04.095671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:04.109975 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1f71219c-c895-4461-803a-5f7c4f18071f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.283218 Jan 19 01:00:04.120029 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 93/181] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:03 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:04.483664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:04.489690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:04.512568 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:04.514911 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:04.517309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:04.518845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:04.684813 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b81f592c-c512-40a3-bf5c-016b7cd959ff tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 15110 microversion: 2.1 time: 0.211765 Jan 19 01:00:04.686483 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 89/182] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:04 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 15110 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:04.746461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:04.750039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:04.765700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:04.774406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:04.776494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:04.779290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:04.956735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3b741266-6210-406b-b195-f59dc9363f0c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 11851 microversion: 2.20 time: 0.221075 Jan 19 01:00:04.958091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 94/183] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:04 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 11851 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:05.142983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:05.148745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:05.166911 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:05.169979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:05.171594 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:05.172440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:05.496121 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:05.522027 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-db07eb21-6eea-4347-9189-1627f4153071 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.387391 Jan 19 01:00:05.523991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 90/184] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:05 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:05.710529 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:05.711203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:05.718626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:05.719088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:05.719960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:05.720399 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:05.981716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:05.985755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:05.999116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:06.000114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:06.001592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:06.003221 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:07.869340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-107c38ec-1366-4332-83c2-796ffadc68b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 20997 microversion: 2.1 time: 2.173703 Jan 19 01:00:07.876433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 95/185] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:05 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 20997 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:07.890816 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:07.894389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:07.913076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:07.913844 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:07.914899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-808f6687-114c-4248-b2cb-c40f2e637ffa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 19040 microversion: 2.20 time: 1.947520 Jan 19 01:00:07.915401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:07.915401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:07.924297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 91/186] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:05 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 19040 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:08.188486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:08.200417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-146a50a7-1a08-4b86-90a9-349299cd2a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.324486 Jan 19 01:00:08.201746 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 96/187] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:07 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:08.471048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-173447482", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "a5df2d14-6c77-4859-a21d-41a9de91756c"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:08.552058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] validate_networks() for [('a5df2d14-6c77-4859-a21d-41a9de91756c', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:00:08.888593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:08.890146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:08.904617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:08.905748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:08.908585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:08.909548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.047600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-864d5e88-4e1f-4e58-8547-1038ad9a0ed6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 22546 microversion: 2.1 time: 0.165716 Jan 19 01:00:09.049692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 97/188] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:08 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 22546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:09.107625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:09.111696 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:09.129384 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.146293 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.149402 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.153237 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.200702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:00:09.201500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:00:09.203332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:00:09.206262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:00:09.206943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:00:09.242691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.244018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.245452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.246159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.330003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5e1c589a-e756-48b5-b5ce-925eb1b2f1d2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 21966 microversion: 2.20 time: 0.270661 Jan 19 01:00:09.338605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 98/189] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:09 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 21966 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:09.352269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:09.353634 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:09.366740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.367331 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.370761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:09.371486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:09.548808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:00:09.569974 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for user b46dddae0c2347d399239aaee9b2c486 and project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:00:09.594084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:00:09.598703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:00:09.607528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:09.619340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b1c4ddba-1e03-4a62-9f69-ad79e78f0903 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.278567 Jan 19 01:00:09.622043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 99/190] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:09 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:09.692600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b7e6ed86-bfe5-4b09-a6b1-b7d8200446c5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446861 Jan 19 01:00:09.700538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 92/191] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:00:09.712752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1d855d6e-a155-490a-adf3-85407b295e4c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:09.714036 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1d855d6e-a155-490a-adf3-85407b295e4c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:09.833338 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1d855d6e-a155-490a-adf3-85407b295e4c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:09.857608 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1d855d6e-a155-490a-adf3-85407b295e4c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1217 microversion: 2.1 time: 0.154470 Jan 19 01:00:09.858851 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 100/192] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:09 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:10.068146 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:10.069988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:10.097941 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.100476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.104274 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.106414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.282816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c1cac6d7-def2-48c3-9e31-75f67fd1c237 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 23923 microversion: 2.1 time: 0.221323 Jan 19 01:00:10.290714 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 93/193] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:10 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 23923 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:10.342518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:10.345517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:10.358052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.359078 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.360479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.361214 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.481200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e421b4a5-9a58-42f8-9dc9-be48ec6c547c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 23227 microversion: 2.20 time: 0.145256 Jan 19 01:00:10.482611 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 101/194] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:10 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 23227 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:10.638414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:10.639154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:10.647720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.648167 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.649233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.649910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.881362 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:10.882207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:10.898006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.898974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.899863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:10.900660 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:10.983636 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:10.995831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0d97ce3b-cf2d-424c-bd85-1e64bea2e8ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.361291 Jan 19 01:00:10.996235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:10.996827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 94/195] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:10 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:11.006582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f9db7097-958e-4aea-b201-ce74ae19b254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1269 microversion: 2.1 time: 0.130836 Jan 19 01:00:11.007582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 102/196] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:10 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:11.302798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:11.303947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:11.319290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:11.322366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:11.324465 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:11.325710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:11.531651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:11.536094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:11.563154 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:11.569204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:11.571710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:11.574059 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:11.583108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-03329a95-4a9d-4b98-a96d-fe4fa59f4a36 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 25057 microversion: 2.1 time: 0.287652 Jan 19 01:00:11.586643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 95/197] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:11 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 25057 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:11.790745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fba46ede-6763-4a6a-a3b5-f2877e277e73 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 24721 microversion: 2.20 time: 0.283157 Jan 19 01:00:11.793143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 103/198] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:11 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 24721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:12.020222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:12.030262 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:12.032069 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:12.034006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:12.062097 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.063437 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.065057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.066613 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.069409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.070264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.072540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.074109 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.264811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:12.283991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8c8519a4-dfd3-4899-af27-9a194cb409a7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1275 microversion: 2.1 time: 0.261042 Jan 19 01:00:12.285390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 104/199] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:12 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1275 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:12.431062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:12.445630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5aad456d-4446-4f32-8d8a-b44169a83309 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.432739 Jan 19 01:00:12.447392 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 96/200] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:12 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:12.603134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:12.604810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:12.626641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.627293 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.628320 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.629024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.765187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-51883061-ca40-45e5-88f2-06aa0329662a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 26128 microversion: 2.1 time: 0.168854 Jan 19 01:00:12.767326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 105/201] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:12 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 26128 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:12.809183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:12.810937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:12.837520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.840210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:12.845680 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:12.847706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.004735 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fb08f0f0-aa44-461b-ae39-fdf62247b757 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 25880 microversion: 2.20 time: 0.202002 Jan 19 01:00:13.007659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 97/202] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:12 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 25880 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:13.324324 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:13.326548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:13.340991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.342066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.351468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.352075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.469876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:13.472477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:13.483286 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.484170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.485926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.486913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.663204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:13.689327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-548b1eb3-bc7e-43c0-9bf0-bca01a2f0678 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.373246 Jan 19 01:00:13.705512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 106/203] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:13 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:13.721812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:13.739845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-518c9174-ab5d-458c-ac92-7de34d4a85dd tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.274938 Jan 19 01:00:13.740645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 98/204] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:13 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:13.783894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:13.785464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:13.799293 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.800369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.801656 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:13.802143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:13.959844 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-107a1343-7c34-44ed-920e-de4aa86020f0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 26889 microversion: 2.1 time: 0.181556 Jan 19 01:00:13.962330 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 107/205] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:13 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 26889 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:14.026110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:14.027817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:14.040877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.042815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.045008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.046076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.207191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8b2e3fba-2e8d-4380-b412-81e8447cb790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 26606 microversion: 2.20 time: 0.187835 Jan 19 01:00:14.208799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 99/206] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:14 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 26606 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:14.267850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-81ae6e89-731e-483f-9ff7-a203627fa9ef req-262467cd-b4b6-4271-a9e9-7564d05db790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a211ed3-91b3-49a8-8ccd-fe71a9359bfd", "tag": "48d03b9f-93ff-487d-8eb8-b6d6155cceb0"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:14.270935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:14.270935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:00:14.291319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-81ae6e89-731e-483f-9ff7-a203627fa9ef req-262467cd-b4b6-4271-a9e9-7564d05db790 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.291890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-81ae6e89-731e-483f-9ff7-a203627fa9ef req-262467cd-b4b6-4271-a9e9-7564d05db790 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.319339 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-81ae6e89-731e-483f-9ff7-a203627fa9ef req-262467cd-b4b6-4271-a9e9-7564d05db790 service nova] Creating event network-changed:48d03b9f-93ff-487d-8eb8-b6d6155cceb0 for instance 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd on hv-cinder-79987 Jan 19 01:00:14.325347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-81ae6e89-731e-483f-9ff7-a203627fa9ef req-262467cd-b4b6-4271-a9e9-7564d05db790 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061547 Jan 19 01:00:14.329476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 108/207] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:14.732330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:14.733956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:14.748362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.749402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.755519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.756564 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.761901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:14.765086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:14.781137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.790368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:14.791404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:14.794041 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:15.135324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:15.152109 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7d731e35-ce26-48e1-a7f3-8a692c10eafe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.431790 Jan 19 01:00:15.153650 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 100/208] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:14 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:15.163728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:15.165903 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:15.178784 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:15.180024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:15.181290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:15.182069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:15.253879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:15.277947 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dd97a5dd-d293-47e9-8e5e-8e0ab9aaf7f0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.519873 Jan 19 01:00:15.278708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 109/209] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:14 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:15.286111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:15.287483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:15.295404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:15.295952 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:15.296843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:15.297385 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:15.402543 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-39355868-1019-4b50-946e-8a5bcce84ac1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 27417 microversion: 2.1 time: 0.246389 Jan 19 01:00:15.404000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 101/210] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:15 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 27417 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:15.437726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ddd2a9f3-843a-4a25-8b86-2e8b6399c021 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 27358 microversion: 2.20 time: 0.156729 Jan 19 01:00:15.439035 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 110/211] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:15 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 27358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:16.178818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:16.180190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:16.198407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.200796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.203323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.205445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.308313 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:16.310936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:16.339969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.340410 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.342442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.342892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.539930 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:16.550567 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e3c5b71e-797b-4f24-b29a-080588001917 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.382385 Jan 19 01:00:16.553410 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 102/212] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:16 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:16.559964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:16.561635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:16.571344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.572226 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.573523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.574575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.715140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8d95ed40-df91-4f23-b345-b19026dc2cc8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 27672 microversion: 2.1 time: 0.159904 Jan 19 01:00:16.721850 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 103/213] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:16 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 27672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:16.726477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:16.727885 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:16.740901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.740901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.741486 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:16.742459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:16.748028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:16.771983 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f6ac3f31-5db3-4cae-95c4-a840d6777abe tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1521 microversion: 2.1 time: 0.473367 Jan 19 01:00:16.776498 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 111/214] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:16 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:16.968243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-82e18e31-5ed8-424d-b67f-2b3b3bac9901 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 27652 microversion: 2.20 time: 0.249989 Jan 19 01:00:16.969072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 104/215] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:16 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 27652 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:17.580258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:17.581245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:17.590479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.591166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.592194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.592775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.730524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:17.731891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:17.747143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.748211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.751269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.752611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.862449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:17.875527 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-88a3fdd2-fdf6-4747-a5f1-33b6bc00d4dd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.299761 Jan 19 01:00:17.895165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 112/216] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:17 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:17.901278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:17.902870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:17.912738 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.922945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.922945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:17.922945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:17.923346 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3fdda76a-eb6e-443a-bf09-872f257b3157 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28050 microversion: 2.1 time: 0.194649 Jan 19 01:00:17.923346 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 105/217] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:17 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28050 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:17.987600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:17.988977 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:17.999592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.000246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.001512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.002170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.157404 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-333f8770-12a1-4337-b946-aa0f74c7e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 27898 microversion: 2.20 time: 0.178178 Jan 19 01:00:18.158952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 106/218] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:17 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 27898 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:18.188394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:18.211801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-db6486be-02cd-438f-83b5-6a1bf2e8b20e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1501 microversion: 2.1 time: 0.314615 Jan 19 01:00:18.212450 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 113/219] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:17 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:18.243264 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:18.244608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:18.267821 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.268727 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.271980 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.273213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.510737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:18.525616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-20824d5f-fc6a-4042-bdc7-9fea4ff1ef3e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1514 microversion: 2.1 time: 0.289221 Jan 19 01:00:18.538104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 107/220] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:18 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:18.905402 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:18.906736 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:18.919124 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.920380 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.921806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.922579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.947082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:18.949897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:18.962743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.965079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:18.968023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:18.968728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:19.089316 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c9c5c1b4-69ab-42ee-9e14-19be168e670f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28151 microversion: 2.1 time: 0.148432 Jan 19 01:00:19.090432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 108/221] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:18 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28151 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:19.176668 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:19.177926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:19.184620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:19.195714 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:19.196578 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:19.197259 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c36a7f70-ed44-4430-8073-9a8fa3a37034 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.297454 Jan 19 01:00:19.199770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 114/222] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:18 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:19.200774 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:19.201367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:19.335617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-55b94618-7536-4864-83d1-42507a2379a6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28196 microversion: 2.20 time: 0.165217 Jan 19 01:00:19.343312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 109/223] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:19 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28196 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:20.103445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:20.104681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:20.112349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.112858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.113819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.114286 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.246733 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:20.248317 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:20.266950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1601c2df-cd80-4a22-8f31-9d8b4d05b1c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28151 microversion: 2.1 time: 0.168386 Jan 19 01:00:20.268711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 115/224] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:20 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28151 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:20.274971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.276495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.277777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.278625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.354416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:20.359287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:20.387659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.388497 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.389763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.390414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.565600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-01274488-972f-4c2e-9613-aa47c1abcb83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28196 microversion: 2.20 time: 0.209882 Jan 19 01:00:20.565600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 116/225] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:20 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28196 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:20.587394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:20.588942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:20.620794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.628024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.628909 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.630307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.670985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'flavor' on Instance uuid b1e02678-2973-4080-be5a-b589dd630ec9 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:00:20.694769 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:20.705014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cf51b224-7f29-4c99-9b70-d0bfb4a2c54b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.483325 Jan 19 01:00:20.706184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 110/226] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:20 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:20.773872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1411272826", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "3b4a6eca-bc34-40ef-838e-484e8a43c7dd"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:20.842595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-23cae93a-bc6c-4ab2-bdc5-70a303b140c9 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action" status: 200 len: 32 microversion: 2.1 time: 0.279980 Jan 19 01:00:20.850240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 117/227] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:20 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:00:20.856998 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:20.857922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:20.865264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.866154 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:20.867731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:20.868878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.159083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:21.184573 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4a0a3227-d83f-4425-94e5-286de9164a6b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.331462 Jan 19 01:00:21.198971 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 118/228] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:20 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:21.282222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:21.283534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:21.292360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.292696 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.293667 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.294173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.445541 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c91235de-3ee5-4af3-a3d1-331506f77f98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28441 microversion: 2.1 time: 0.168018 Jan 19 01:00:21.447823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 119/229] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:21 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28441 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:21.582519 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:21.588740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:21.617488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.617488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.617488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.617488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.789022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-53f5e148-4696-45f1-b3d6-2830c3aae978 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28487 microversion: 2.20 time: 0.218787 Jan 19 01:00:21.799821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 120/230] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:21 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28487 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:21.815285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:21.816504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:21.840853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.842030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:21.842887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:21.843514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:22.071563 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:22.083415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cf0c9007-22c3-437e-8bd8-fdb30e23951f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.279776 Jan 19 01:00:22.087651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 121/231] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:21 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:22.098167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-158ea27d-2f6e-4a53-a7cd-a00e690d53db req-3ad9b7fa-cac7-4d0c-9c66-44e10b0d9324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a211ed3-91b3-49a8-8ccd-fe71a9359bfd", "name": "network-vif-plugged", "status": "completed", "tag": "48d03b9f-93ff-487d-8eb8-b6d6155cceb0"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:22.103145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:22.103145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:00:22.111152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-158ea27d-2f6e-4a53-a7cd-a00e690d53db req-3ad9b7fa-cac7-4d0c-9c66-44e10b0d9324 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:22.111596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-158ea27d-2f6e-4a53-a7cd-a00e690d53db req-3ad9b7fa-cac7-4d0c-9c66-44e10b0d9324 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:22.124254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-158ea27d-2f6e-4a53-a7cd-a00e690d53db req-3ad9b7fa-cac7-4d0c-9c66-44e10b0d9324 service nova] Creating event network-vif-plugged:48d03b9f-93ff-487d-8eb8-b6d6155cceb0 for instance 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd on hv-cinder-79987 Jan 19 01:00:22.131008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-158ea27d-2f6e-4a53-a7cd-a00e690d53db req-3ad9b7fa-cac7-4d0c-9c66-44e10b0d9324 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044233 Jan 19 01:00:22.131448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 122/232] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:22.214689 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:22.215850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:22.229376 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:22.240283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:22.241411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:22.242098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:22.566422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:22.583098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3833de26-4fbc-45b1-80a5-f5734defc9e0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.375235 Jan 19 01:00:22.584046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 123/233] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:22 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:22.597962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:22.599462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:22.610624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:22.611165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:22.611993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:22.612520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.081147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a2d1409f-8836-4aa8-8d77-4d20f124ba7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.486841 Jan 19 01:00:23.082543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 124/234] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:22 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:23.093208 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:23.094925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:23.108980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.109811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.111316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.112119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.284771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0222eb20-3e50-433e-b6d6-d5fa150d654d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28557 microversion: 2.20 time: 0.200079 Jan 19 01:00:23.287745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 125/235] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:23 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:23.300132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:23.302706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:23.315185 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.316007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.317458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.318317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.523117 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:23.535083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-00cc4a9d-1426-4f20-b728-fa6f764c0518 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1317 microversion: 2.1 time: 0.244560 Jan 19 01:00:23.536430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 126/236] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:23 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:23.603599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:23.604440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:23.615046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.615788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.617129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:23.618032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:23.831266 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:23.847054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f7160103-9ba1-4b7a-8694-dd9a397386ea tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.249609 Jan 19 01:00:23.848086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 127/237] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:23 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:24.098331 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:24.099588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:24.110252 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.111358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.113006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.114249 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.268129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c63f4a48-7aeb-4b60-9933-e127e9c4b7f1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.173244 Jan 19 01:00:24.269312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 128/238] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:24 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:24.327258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:24.329353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:24.347597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.348492 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.350589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.351461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.496220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ee395a0d-a7c8-4fc6-86f1-629ae8a79b16 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28648 microversion: 2.20 time: 0.198209 Jan 19 01:00:24.497017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 129/239] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:24 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28648 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:24.562255 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:24.563009 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:24.570463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.570917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.571732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.572171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.721031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:24.729896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ac1feb5e-3d4e-44d3-9e17-3bed0164dc00 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1507 microversion: 2.1 time: 0.171716 Jan 19 01:00:24.730506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 130/240] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:24 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:24.869265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:24.870640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:24.881699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.882897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:24.884438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:24.885239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:25.118346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:25.130343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-81a76750-f2f3-4df5-ab64-d2be03b804f6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.268715 Jan 19 01:00:25.131432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 131/241] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:24 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:25.282481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:25.284286 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:25.292960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:25.293838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:25.294809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:25.295334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:25.405908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ce7eabb9-8862-4273-b90a-a2a515812592 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.127571 Jan 19 01:00:25.406894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 132/242] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:25 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:25.511419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:25.512874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:25.523899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:25.525438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:25.527090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:25.527576 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:25.644517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-faef64e6-eb25-4e43-86aa-a2bb1d494d74 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28648 microversion: 2.20 time: 0.137204 Jan 19 01:00:25.645197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 133/243] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:25 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28648 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:26.160285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:26.161021 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:26.169492 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.170280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.171223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.171724 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.352173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:26.360359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a059efc9-dfd3-49c3-be3b-445b04126cd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.206328 Jan 19 01:00:26.360953 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 134/244] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:26 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:26.366351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32af780b-52b5-452c-9a57-445537cbfacd"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:26.367441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:26.376918 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.377449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.379595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.380670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.684867 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8fe2e063-23d0-4fda-aea1-ee6778cab3a4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322057 Jan 19 01:00:26.685614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 135/245] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:00:26 2022] POST /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:26.692260 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:26.693984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:26.700662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.701460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.703169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.705144 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.838641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fac60269-7980-409d-87f8-eae38ae2647b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.151114 Jan 19 01:00:26.839488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 136/246] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:26 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:26.850114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:26.851476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:26.860019 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.860475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.861290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:26.861769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:26.995342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ddea34d8-f440-49d1-b956-923d119f2131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28648 microversion: 2.20 time: 0.149718 Jan 19 01:00:26.997163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 137/247] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:26 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28648 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:27.381854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:27.383025 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:27.391814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:27.392433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:27.393430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:27.393988 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:27.598906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:27.609977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a0e54bba-efb9-4f30-b18f-d6fb202c77d0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.232460 Jan 19 01:00:27.611056 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 138/248] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:27 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:27.767098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] validate_networks() for [('3b4a6eca-bc34-40ef-838e-484e8a43c7dd', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:00:27.852673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:27.854630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:27.865968 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:27.867809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:27.869093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:27.870672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:27.992648 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d8fc0930-cf77-4ddf-9ac3-fef620478768 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.145251 Jan 19 01:00:27.997786 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 139/249] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:27 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:28.013983 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:28.019155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:28.032585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.033704 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.035130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.035909 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.162752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-119fd115-25bd-4774-a4f7-ab18f8497d7b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28648 microversion: 2.20 time: 0.153405 Jan 19 01:00:28.164203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 140/250] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:28 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28648 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:28.261861 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:00:28.262309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:00:28.262791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:00:28.263230 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:00:28.263639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:00:28.276152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.277052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.278338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.278944 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.304992 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Getting quotas for project b28795d42306497ea73c57f43a3f8798. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:00:28.310777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Getting quotas for user 5e726e75161b4adb818572c02d463fdc and project b28795d42306497ea73c57f43a3f8798. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:00:28.324503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:00:28.327313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:00:28.386791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0d6ce5f3-8a30-4aca-8dd4-06c7f389bb6a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.617235 Jan 19 01:00:28.387498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 111/251] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 7619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 01:00:28.403375 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e912518a-4d14-47c0-b3ff-cf123fcfe2cd tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:28.404408 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e912518a-4d14-47c0-b3ff-cf123fcfe2cd tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:28.499914 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e912518a-4d14-47c0-b3ff-cf123fcfe2cd tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:28.513591 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e912518a-4d14-47c0-b3ff-cf123fcfe2cd tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1214 microversion: 2.1 time: 0.115567 Jan 19 01:00:28.514187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 141/252] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:28 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:28.632709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:28.634189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:28.641785 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.642620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.643687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:28.644494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:28.984785 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:28.993849 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b4c90966-a5e1-4741-b689-1d71f1245f43 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.368609 Jan 19 01:00:28.995061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 112/253] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:28 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:29.005860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:29.007578 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:29.015002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.015936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.017449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.018194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.153782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0571603c-c58e-47ef-99b0-7bf02c3740f4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 28609 microversion: 2.1 time: 0.152261 Jan 19 01:00:29.154902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 142/254] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:28 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 28609 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:29.176996 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:29.178208 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:29.184801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.185395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.186282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.186781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.323349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5df12a26-53af-4a9a-95cd-2036d4d96dbe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 28648 microversion: 2.20 time: 0.150266 Jan 19 01:00:29.324217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 113/255] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:29 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 28648 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:29.533758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:29.534505 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:29.542368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.542735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.543734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:29.544180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:29.642419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:29.658119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fed78916-2211-4bad-a620-8636f2f67c95 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1266 microversion: 2.1 time: 0.129488 Jan 19 01:00:29.659188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 143/256] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:29 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:30.019599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:30.020522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:30.034142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.034484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.035301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.035736 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.169509 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:30.170575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:30.180002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.180290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.181284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.181641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.359496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c60ede11-4c16-40f3-8af8-db44504935a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 29027 microversion: 2.1 time: 0.195218 Jan 19 01:00:30.369076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 144/257] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:30 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 29027 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:30.380642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:30.383063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:30.397817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.398942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.400977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.402073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.449374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:30.474280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5c06d0bd-0a3d-4e48-9b9f-6f6e15700faa tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.457881 Jan 19 01:00:30.474755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 114/258] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:30 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:30.581196 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-03f2e2af-9bc4-4211-8954-69b5c26d53a4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 29075 microversion: 2.20 time: 0.208919 Jan 19 01:00:30.582111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 145/259] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:30 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 29075 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:30.677365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:30.678501 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:30.690664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.691365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.696262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:30.698983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:30.829370 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:30.840979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-edba0235-2ded-47aa-87f8-d6b2e45d3fd6 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1272 microversion: 2.1 time: 0.168391 Jan 19 01:00:30.842046 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 115/260] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:30 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:31.377017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:31.378309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:31.386407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.387240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.388207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.388624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.499671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:31.500508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:31.508073 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.508529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.509344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.509818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.544761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-65c92119-0bf3-4cd9-840f-fdf7cb7c0ce1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 30026 microversion: 2.1 time: 0.171829 Jan 19 01:00:31.546098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 146/261] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:31 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 30026 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:31.597002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:31.598669 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:31.606464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.607326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.608607 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.609078 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.729491 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:31.740567 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3b29d143-3218-4c70-942d-fcadd77c2040 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.243846 Jan 19 01:00:31.750493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 116/262] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:31 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:31.754053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e936aa9c-2fee-4ad5-a445-dc7e98d8508e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 30375 microversion: 2.20 time: 0.161470 Jan 19 01:00:31.754734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 147/263] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:31 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 30375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:31.862103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:31.863315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:31.875488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.876285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:31.877657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:31.878758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.104006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:32.123147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c9bd9c0c-bdce-4b03-b8d3-f9b7f5f51f02 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.266328 Jan 19 01:00:32.124654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 117/264] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:31 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:32.154502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-3b30ce73-54b1-47ec-9bd3-bcc82aa226eb req-b3060dc3-3c4e-4237-843c-e58531ca2ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6d429d-eb4e-4664-a812-cb7671ac4ab3", "tag": "c8d06d74-636e-4c13-927f-0fe056e4383d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:32.156470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:32.156470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:00:32.171411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3b30ce73-54b1-47ec-9bd3-bcc82aa226eb req-b3060dc3-3c4e-4237-843c-e58531ca2ba0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.172139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3b30ce73-54b1-47ec-9bd3-bcc82aa226eb req-b3060dc3-3c4e-4237-843c-e58531ca2ba0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.186922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-3b30ce73-54b1-47ec-9bd3-bcc82aa226eb req-b3060dc3-3c4e-4237-843c-e58531ca2ba0 service nova] Creating event network-changed:c8d06d74-636e-4c13-927f-0fe056e4383d for instance 9a6d429d-eb4e-4664-a812-cb7671ac4ab3 on hv-cinder-79987 Jan 19 01:00:32.192743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-3b30ce73-54b1-47ec-9bd3-bcc82aa226eb req-b3060dc3-3c4e-4237-843c-e58531ca2ba0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049546 Jan 19 01:00:32.193391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 148/265] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:32.562811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:32.565581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:32.578147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.578907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.580290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.581049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.739170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4f5a0836-0a7e-43fc-93ba-ac97175a8909 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 31249 microversion: 2.1 time: 0.182887 Jan 19 01:00:32.740709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 118/266] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:32 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 31249 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:32.761507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:32.767048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:32.768107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:32.771523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:32.779367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.780518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.781806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.782438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.785200 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.787078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.789930 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:32.791342 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:32.961353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:32.970527 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bc5ca6f3-fd1a-46ff-8f8f-9e49f69f0306 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.215708 Jan 19 01:00:32.972142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 149/267] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:32 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:33.033265 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fa9bc1f9-96b8-4445-bbc9-5bd4d94ee747 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 31462 microversion: 2.20 time: 0.269985 Jan 19 01:00:33.036761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 119/268] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:32 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 31462 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:33.147011 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:33.148951 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:33.171987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:33.172917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:33.174351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:33.175601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:33.678650 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:33.710916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5b7d8bd1-08f8-4d47-996a-ffed1801e6ce tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.555379 Jan 19 01:00:33.712167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 150/269] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:33 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:33.762285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:33.764219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:33.774140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:33.774592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:33.775964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:33.776692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:33.967242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-56425762-e2be-45fe-a167-8292b16b378b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 31940 microversion: 2.1 time: 0.215637 Jan 19 01:00:33.969071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 120/270] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:33 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 31940 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:33.988147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:33.988838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:33.999081 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:33.999848 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.001182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:34.001939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.054429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:34.056176 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:34.068050 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:34.068985 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.070621 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:34.071513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.183814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:34.205124 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-df737955-78ac-448e-996f-2c90815e3b9a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.220930 Jan 19 01:00:34.206232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 151/271] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:33 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:34.277206 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-27a6eaff-4829-4503-a59d-c59be79ae662 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 32244 microversion: 2.20 time: 0.230406 Jan 19 01:00:34.279303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 121/272] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:34 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 32244 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:34.729224 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-302932364", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "a5df2d14-6c77-4859-a21d-41a9de91756c"}]}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:34.735546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:34.736906 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:34.757814 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:34.758604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.760301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:34.761690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:34.802788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] validate_networks() for [('a5df2d14-6c77-4859-a21d-41a9de91756c', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:00:35.074324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:35.083978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1d4998d5-c30f-44b8-9984-42fed83a3fd0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.357382 Jan 19 01:00:35.084573 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 122/273] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:34 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:35.090300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:35.091539 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:35.098164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.099131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.100281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.100922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.217142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-244694c4-7fd4-4086-8126-d4d13d91b992 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 32822 microversion: 2.1 time: 0.130769 Jan 19 01:00:35.217742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 123/274] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:35 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 32822 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:35.229759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:35.230479 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:35.238284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.238795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.239661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.240104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.333760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:00:35.334621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:00:35.335149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:00:35.335781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:00:35.336381 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:00:35.347820 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.348332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.349749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.350433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.369988 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:00:35.374845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for user b46dddae0c2347d399239aaee9b2c486 and project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:00:35.389733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:00:35.392099 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:00:35.452585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6e3a05b4-e4f0-4463-a869-8249c45b4a98 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727145 Jan 19 01:00:35.453641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 152/275] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:00:35.458881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:35.459922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:35.468325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.469424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.470328 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:35.470800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:35.495570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:35.508625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a8865695-1031-4cf3-9ec2-2abc26544fae tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.282986 Jan 19 01:00:35.510666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 124/276] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:35 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:35.518391 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6f64ed57-6c19-4000-82dc-864352cac84a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:35.520116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6f64ed57-6c19-4000-82dc-864352cac84a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:35.606943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-936b2e6a-bd03-4045-9ef1-17e8fb115097 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 33240 microversion: 2.20 time: 0.151953 Jan 19 01:00:35.611652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6f64ed57-6c19-4000-82dc-864352cac84a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:35.614416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 153/277] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:35 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 33240 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:35.624235 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6f64ed57-6c19-4000-82dc-864352cac84a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1217 microversion: 2.1 time: 0.111593 Jan 19 01:00:35.635255 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 125/278] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:35 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:36.118511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:36.119671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:36.134715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.136540 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.138151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.138773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.231160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:36.232663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:36.247443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.249972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.251812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.252932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.385614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:36.397086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cc4b9dde-5e88-4e58-a69f-1f98ec47834a tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.288656 Jan 19 01:00:36.445958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 154/279] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:36 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:36.464122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-39657792-4ada-4ddf-953d-6f6f346de7b1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 33370 microversion: 2.1 time: 0.204175 Jan 19 01:00:36.468553 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 126/280] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:36 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 33370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:36.530573 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:36.531641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:36.553622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.554077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.554892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.555322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.639098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:36.640953 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:36.655634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.657243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.660018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.662163 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.725883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:36.733841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dab4a1df-a81b-4223-b1f3-0877f600f019 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.208385 Jan 19 01:00:36.734443 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 155/281] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:36 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:36.741693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:36.741693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:36.747628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.748086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.748881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:36.749315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:36.816763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:36.831462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-60d5717a-cb6b-45ad-9571-76fd64713b08 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1269 microversion: 2.1 time: 0.095592 Jan 19 01:00:36.832917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 156/282] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:36 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:36.837589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-15282c5b-429c-4020-a8e0-d4b06fe89a4a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 33704 microversion: 2.20 time: 0.211726 Jan 19 01:00:36.839301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 127/283] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:36 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 33704 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:37.477275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:37.477275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:37.479267 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.481208 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.481810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.482908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.495387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:37.497107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:37.511038 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.511201 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.513036 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.514791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.707253 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fbd3258f-8bb6-43db-87a0-b694666cb700 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 33729 microversion: 2.1 time: 0.221665 Jan 19 01:00:37.713271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 128/284] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:37 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 33729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:37.770162 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:37.773275 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:37.786853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.788260 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.790600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.791679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.805114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:37.830819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7a3ff534-39cd-44db-ad36-1d49cca6c34c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.365851 Jan 19 01:00:37.846990 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 157/285] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:37 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:37.862189 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:37.863175 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:37.878295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.878782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:37.881149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:37.884768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.046786 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1cfa1eaa-d8ab-4f22-a235-af1614c4c3a0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 34149 microversion: 2.20 time: 0.196805 Jan 19 01:00:38.048107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 158/286] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:37 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 34149 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:38.058494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:38.059400 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:38.059871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:38.070519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e6daef72-b513-42d2-a402-de535f55857d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.312458 Jan 19 01:00:38.071566 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 129/287] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:37 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:38.074067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.074925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.076256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.077132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.177490 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:38.190147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-037f9bf0-52e3-4603-9d86-ed4d4865a9fd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1275 microversion: 2.1 time: 0.140108 Jan 19 01:00:38.191152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 159/288] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:38 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:38.723900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:38.725573 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:38.736433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.737202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.738307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.738806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.861289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:38.862156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:38.871094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.871854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:38.873055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:38.873848 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:39.051164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:39.068671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4716d9ad-75df-4eb9-9027-ed734309e63c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.211987 Jan 19 01:00:39.069937 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 160/289] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:38 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:39.076794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:39.078235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:39.085449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:39.086428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:39.087544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:39.088431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:41.658191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-05bc7a02-d349-4865-9ee1-5a6ad31c0084 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 36767 microversion: 2.1 time: 2.938188 Jan 19 01:00:41.667021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 130/290] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:38 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 36767 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:41.679007 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:41.680864 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:41.685266 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f8bff250-d3fe-4c45-adc2-400cf5a9f432 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 36634 microversion: 2.20 time: 2.612313 Jan 19 01:00:41.694086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 161/291] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:39 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 36634 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:41.713677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:41.714829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:41.716085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:41.716622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:41.718995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:41.719988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:41.746274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:41.747396 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:41.749678 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:41.750757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:41.954080 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:41.963361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-34c8d806-f67e-461c-b2d2-e8a4b4e3d253 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.294163 Jan 19 01:00:41.974533 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 131/292] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:41 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:41.980638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:41.981682 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:41.998896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.000287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.000476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.002790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.223063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:42.237965 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d6418835-d69b-4773-a331-663d22f0f676 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.266151 Jan 19 01:00:42.238526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 132/293] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:41 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:42.245478 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-14ba1a45-45ef-46cf-a277-b223d3f81602 req-bb65db61-a658-4415-bb9c-efaba73b611a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f35a8a-ede6-447d-ac17-3ada99f11829", "tag": "c2be2345-4d5f-41d3-8dda-d7f97540e714"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:42.247393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:42.247393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:00:42.261094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-14ba1a45-45ef-46cf-a277-b223d3f81602 req-bb65db61-a658-4415-bb9c-efaba73b611a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.261753 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-14ba1a45-45ef-46cf-a277-b223d3f81602 req-bb65db61-a658-4415-bb9c-efaba73b611a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.275396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-14ba1a45-45ef-46cf-a277-b223d3f81602 req-bb65db61-a658-4415-bb9c-efaba73b611a service nova] Creating event network-changed:c2be2345-4d5f-41d3-8dda-d7f97540e714 for instance 58f35a8a-ede6-447d-ac17-3ada99f11829 on hv-cinder-79987 Jan 19 01:00:42.282310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-14ba1a45-45ef-46cf-a277-b223d3f81602 req-bb65db61-a658-4415-bb9c-efaba73b611a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042033 Jan 19 01:00:42.283632 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 133/294] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:42.290890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-cad54c70-ab76-433d-af9c-935bcb047266 req-2a8502e1-7501-4048-8436-50a1f3959caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6d429d-eb4e-4664-a812-cb7671ac4ab3", "name": "network-vif-plugged", "status": "completed", "tag": "c8d06d74-636e-4c13-927f-0fe056e4383d"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:42.293879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:42.293879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:00:42.303974 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-cad54c70-ab76-433d-af9c-935bcb047266 req-2a8502e1-7501-4048-8436-50a1f3959caa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.304642 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-cad54c70-ab76-433d-af9c-935bcb047266 req-2a8502e1-7501-4048-8436-50a1f3959caa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.320124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-cad54c70-ab76-433d-af9c-935bcb047266 req-2a8502e1-7501-4048-8436-50a1f3959caa service nova] Creating event network-vif-plugged:c8d06d74-636e-4c13-927f-0fe056e4383d for instance 9a6d429d-eb4e-4664-a812-cb7671ac4ab3 on hv-cinder-79987 Jan 19 01:00:42.325247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-cad54c70-ab76-433d-af9c-935bcb047266 req-2a8502e1-7501-4048-8436-50a1f3959caa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040030 Jan 19 01:00:42.325920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 134/295] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:42.679947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:42.681829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:42.685422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:42.689662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.690250 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.691181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.691706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.706158 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-284e2b8f-c86a-4271-aac1-b2d552e621a5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 1.007696 Jan 19 01:00:42.715785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 162/296] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:41 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:42.717541 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:42.722607 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:42.730415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.730976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.732030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:42.732593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:42.881919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1266148f-e5ca-40bf-b0b6-e341ef1d15b2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 37670 microversion: 2.1 time: 0.206597 Jan 19 01:00:42.882872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 135/297] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:42 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 37670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:42.914741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-38cd326d-0376-421b-bf7f-1cffbab1939a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 37594 microversion: 2.20 time: 0.205019 Jan 19 01:00:42.915834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 163/298] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:42 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 37594 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:42.988251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:42.990048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:43.006617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.007419 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.008963 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.009718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.258397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:43.259341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:43.276276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.277180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.278878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.283969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.336166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:43.347527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fae6ea67-54bf-46fe-9c8d-dbe1e61e486d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.367436 Jan 19 01:00:43.349086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 136/299] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:42 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:43.663065 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:43.678502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-51d38e97-2b5f-4630-9334-3084dcd36d77 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.425792 Jan 19 01:00:43.680016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 164/300] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:43 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:43.726022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:43.726687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:43.733627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.734117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.735540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.736009 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.897167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:43.898980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:43.906904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.907760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.909377 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.910107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.932117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:43.943634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0d8218a0-269f-4837-b1d6-3fd71ddbf22a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.221838 Jan 19 01:00:43.944865 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 137/301] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:43 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:43.962331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:43.963021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:43.970500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.972300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:43.973052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:43.973541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:44.053462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4f005c20-429f-41cd-a167-80993f9ce7fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 38092 microversion: 2.1 time: 0.160547 Jan 19 01:00:44.054449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 165/302] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:43 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 38092 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:00:44.152217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c6002747-8a63-467a-8638-260d360c352c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 38161 microversion: 2.20 time: 0.205584 Jan 19 01:00:44.154978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 138/303] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:43 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 38161 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:44.377740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:44.379222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:44.392103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:44.392714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:44.393672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:44.394169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:44.703112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:44.703112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:44.722889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:44.723385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:44.724324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:44.724780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:44.968476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:44.977084 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8706cc10-ccc1-42bc-b7f2-2262cce9c448 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.605750 Jan 19 01:00:44.980782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 166/304] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:44 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:44.997622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:44.998522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:45.011019 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.017327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.018484 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.019088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.125984 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:45.135443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cbdf469f-1db9-466f-bcd7-453d660ab84e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1314 microversion: 2.1 time: 0.441146 Jan 19 01:00:45.147094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 139/305] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:44 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:45.152537 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:45.153499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:45.176792 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.179086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.182859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.184408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.373525 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-02e67d25-6db3-4697-a4bd-47b600227829 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 38092 microversion: 2.1 time: 0.226434 Jan 19 01:00:45.375030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 140/306] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:45 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 38092 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:45.394583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:45.397034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:45.411132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.412484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.414407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:45.415495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:45.453287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:45.467870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c6bdfce1-217a-4a82-8838-8d6ba1c0246e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.485735 Jan 19 01:00:45.485076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 167/307] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:44 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:45.582994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4fdc8dc1-7ca0-46cf-a3b9-e92c41967910 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 38161 microversion: 2.20 time: 0.205561 Jan 19 01:00:45.584219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 141/308] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:45 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 38161 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:46.006081 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:46.036306 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.070388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.071347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.072360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.072956 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.161733 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:46.169709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.194347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.195229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.203786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.205183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.576889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:46.585030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:46.596416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0710afb0-8147-48c3-acfa-0af296d22e04 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.600708 Jan 19 01:00:46.597008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 168/309] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:45 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:46.602648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-379e0264-1b45-4f97-8cad-7842f044d49e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1497 microversion: 2.1 time: 0.445114 Jan 19 01:00:46.604625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 142/310] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:46 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1497 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:46.611239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:46.612238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.614893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:46.616075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.629831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.630488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.631474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.631884 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.632112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.632326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.634579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.635212 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.806871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2ca8e084-473a-4582-b861-c30e4f532a34 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 200 len: 38218 microversion: 2.1 time: 0.199370 Jan 19 01:00:46.818492 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 169/311] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:46 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 38218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:46.832270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:46.843614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.871879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.873130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.875931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.879142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.897036 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:46.907737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-42f90312-008b-488c-b077-3c01f56b0228 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.300626 Jan 19 01:00:46.909699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 143/312] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:46 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:46.932137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:46.932658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:46.950520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.950520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.951669 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:46.952305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:46.991177 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fe24fb7c-de61-4d2c-b5f1-f4f5ce37a7f2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/ips" status: 200 len: 144 microversion: 2.1 time: 0.064890 Jan 19 01:00:46.992526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 144/313] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 01:00:46 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/ips => generated 144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:47.059646 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-113d8605-1408-414e-aaa0-65ccaa90efaa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 200 len: 38302 microversion: 2.20 time: 0.238790 Jan 19 01:00:47.065684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 170/314] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:46 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 38302 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:47.075124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:47.075644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:47.096429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.096889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.097754 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.098245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.136579 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a31055aa-942b-4948-990b-b38c05488b01 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/ips" status: 200 len: 152 microversion: 2.20 time: 0.066779 Jan 19 01:00:47.145913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 145/315] 10.222.0.35 () {60 vars in 1288 bytes} [Wed Jan 19 01:00:47 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/ips => generated 152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:00:47.673353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:47.682449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:47.722949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.735953 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.741266 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.746922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.839091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:47.840101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:47.870900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.872980 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.874663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:47.877467 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:47.960499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:00:48.195954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-277c3e4d-1bb5-485e-8347-9fd8afa2a7e1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 204 len: 0 microversion: 2.1 time: 0.364104 Jan 19 01:00:48.197865 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 146/316] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:00:47 2022] DELETE /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:00:48.212346 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:48.214957 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:48.229633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.232496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.235207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.235861 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.306929 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:48.328086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4dd170f5-c56c-4127-b579-ba851eafc885 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1500 microversion: 2.1 time: 0.708336 Jan 19 01:00:48.334126 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 171/317] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:47 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1500 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:48.342568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:48.343877 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:48.384982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.386075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.392446 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.396243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.658656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:48.670886 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a9f0ee01-f382-440a-8c91-47d69632ad8c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.470881 Jan 19 01:00:48.697013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 147/318] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:48 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:48.726609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38a6bac1-b9d8-4db8-bdf4-829a3850494e"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:48.732666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:48.751505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.752225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.754114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.755991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.780177 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:48.796145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-08df1035-8277-4b90-946a-d1c7713b2ed9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1503 microversion: 2.1 time: 0.459584 Jan 19 01:00:48.797601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 172/319] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:48 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:48.839144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] HTTP exception thrown: Cannot 'attach_volume' instance b1e02678-2973-4080-be5a-b589dd630ec9 while it is in vm_state rescued Jan 19 01:00:48.868596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Returning 409 to user: Cannot 'attach_volume' instance b1e02678-2973-4080-be5a-b589dd630ec9 while it is in vm_state rescued {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:48.872513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fed1cfd5-96b4-4964-821a-23bd216777d6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.172291 Jan 19 01:00:48.874742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 148/320] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:00:48 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 152 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 19 01:00:48.886907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:48.887617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:48.901904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.902416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:48.903280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:48.906841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.106731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-47302e45-ffcb-49a9-bdd8-e1c876aa1c1f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.224697 Jan 19 01:00:49.108034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 173/321] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:48 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:00:49.117671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:49.118509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:49.134052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.135268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.136823 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.144079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.378916 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:49.397051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a5ee45a4-0559-40cc-8a1a-b2c6cc0dd2d2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1508 microversion: 2.1 time: 0.283404 Jan 19 01:00:49.399031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 149/322] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:49 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:49.695236 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:49.696106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:49.712556 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.713095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.713870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.714316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.816062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:49.819373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:49.840577 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.844660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:49.847341 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:49.850580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.039164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:50.060439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-941ad434-a803-4f85-aad3-8e744c700cdd tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.369534 Jan 19 01:00:50.061742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 174/323] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:49 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:50.076590 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:50.077292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:50.086389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.087247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.088306 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.088978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.122621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lazy-loading 'flavor' on Instance uuid fdb95a1c-6e71-42df-9009-f72ff6c3b21b {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:00:50.510653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:50.520825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-60ff5bc3-2da4-4f2b-9167-b89ac10f298b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1503 microversion: 2.1 time: 0.708420 Jan 19 01:00:50.525262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 150/324] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:49 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1503 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:00:50.537836 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc5d4f9-ea9a-44e0-bd24-a6fb59f35d6b"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:50.544027 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:50.576443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.579909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.581456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.588781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.728010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9ace4067-ec96-4127-b0c6-8e685bcadcee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 202 len: 0 microversion: 2.20 time: 0.663553 Jan 19 01:00:50.733247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 175/325] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:00:50 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:00:50.742562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:50.744296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:50.761924 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.765620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:50.766694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:50.767394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.244990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-56d199d0-74a9-474e-9d5f-0fb213b19578 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717084 Jan 19 01:00:51.248701 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 151/326] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:00:50 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:51.305030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:51.307616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:51.325434 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.326794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.328644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.329674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.424744 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:51.439532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-710d3c47-99a0-4c25-afb4-106787885eca tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1508 microversion: 2.1 time: 0.704674 Jan 19 01:00:51.440133 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 176/327] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:50 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:51.444606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:51.458944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:51.487941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.491238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.495158 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.498052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.816130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:51.826175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:51.833366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:51.834889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4d02f64e-cc27-4cd1-9ac1-a6f99bc02bc6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.577462 Jan 19 01:00:51.840061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 152/328] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:00:51 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:00:51.857774 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:51.867783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:51.888364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.889036 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:51.889904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:51.890344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.053042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:52.065790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e1ad0b5f-0a73-49f0-975a-fb0f5b168cf9 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 200 len: 1299 microversion: 2.1 time: 0.221853 Jan 19 01:00:52.067773 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 153/329] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:51 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:52.073024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-f5744afa-735d-4899-a8e1-5aa12d352e3a req-bda052a4-c2fe-4be9-abb5-c581771211a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6d429d-eb4e-4664-a812-cb7671ac4ab3", "name": "network-vif-deleted", "tag": "c8d06d74-636e-4c13-927f-0fe056e4383d"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:52.080678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:52.080678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:00:52.093659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-f5744afa-735d-4899-a8e1-5aa12d352e3a req-bda052a4-c2fe-4be9-abb5-c581771211a1 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.094477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-f5744afa-735d-4899-a8e1-5aa12d352e3a req-bda052a4-c2fe-4be9-abb5-c581771211a1 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.126276 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-f5744afa-735d-4899-a8e1-5aa12d352e3a req-bda052a4-c2fe-4be9-abb5-c581771211a1 service nova] Creating event network-vif-deleted:c8d06d74-636e-4c13-927f-0fe056e4383d for instance 9a6d429d-eb4e-4664-a812-cb7671ac4ab3 on hv-cinder-79987 Jan 19 01:00:52.150852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-f5744afa-735d-4899-a8e1-5aa12d352e3a req-bda052a4-c2fe-4be9-abb5-c581771211a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081491 Jan 19 01:00:52.151656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 154/330] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:52.157318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-4ec3d0f7-3930-48d4-a011-ae07cb05bcd9 req-fee85342-51fa-4a5f-9f63-e75794d3b536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f35a8a-ede6-447d-ac17-3ada99f11829", "name": "network-vif-plugged", "status": "completed", "tag": "c2be2345-4d5f-41d3-8dda-d7f97540e714"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:52.159586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:00:52.159586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:00:52.169521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-4ec3d0f7-3930-48d4-a011-ae07cb05bcd9 req-fee85342-51fa-4a5f-9f63-e75794d3b536 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.170410 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-4ec3d0f7-3930-48d4-a011-ae07cb05bcd9 req-fee85342-51fa-4a5f-9f63-e75794d3b536 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.201277 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-4ec3d0f7-3930-48d4-a011-ae07cb05bcd9 req-fee85342-51fa-4a5f-9f63-e75794d3b536 service nova] Creating event network-vif-plugged:c2be2345-4d5f-41d3-8dda-d7f97540e714 for instance 58f35a8a-ede6-447d-ac17-3ada99f11829 on hv-cinder-79987 Jan 19 01:00:52.218736 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-4ec3d0f7-3930-48d4-a011-ae07cb05bcd9 req-fee85342-51fa-4a5f-9f63-e75794d3b536 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064664 Jan 19 01:00:52.220681 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 155/331] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:52.317182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:52.358594 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bb3a3df3-a013-4c9c-94a8-145194cef551 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.914508 Jan 19 01:00:52.361535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 177/332] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:51 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:52.473482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:52.479286 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:52.510792 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.512079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.514244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.517041 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.878788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:52.880458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:52.896847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.902930 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:52.904523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:52.905608 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:53.117178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:53.150051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-aafab60d-747d-4103-b905-c3e6730b8cb8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1508 microversion: 2.1 time: 0.686923 Jan 19 01:00:53.150651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 156/333] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:52 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:53.174630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:53.195952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 9a6d429d-eb4e-4664-a812-cb7671ac4ab3] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:53.207982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:53.209202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:53.211358 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:53.212709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:53.245522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] HTTP exception thrown: Instance 9a6d429d-eb4e-4664-a812-cb7671ac4ab3 could not be found. Jan 19 01:00:53.247208 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Returning 404 to user: Instance 9a6d429d-eb4e-4664-a812-cb7671ac4ab3 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:53.253857 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0b0233c8-86b1-483b-8ce7-b08f2873fa76 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3" status: 404 len: 111 microversion: 2.1 time: 0.101619 Jan 19 01:00:53.255792 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 157/334] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:53 2022] GET /compute/v2.1/servers/9a6d429d-eb4e-4664-a812-cb7671ac4ab3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:00:53.395724 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:53.398452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:53.436540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:53.437614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:53.439268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:53.440523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:53.602943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:53.623853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:53.631781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:53.633154 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4d0480af-afa9-4d54-826c-9c84bd215a62 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.765788 Jan 19 01:00:53.649407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 178/335] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:00:52 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:00:53.666426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1818594952", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "3b4a6eca-bc34-40ef-838e-484e8a43c7dd"}]}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:53.810733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] validate_networks() for [('3b4a6eca-bc34-40ef-838e-484e8a43c7dd', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:00:54.240960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:54.248799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7a246f07-a797-4d42-8e00-fce20abaa221 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1317 microversion: 2.1 time: 0.862337 Jan 19 01:00:54.249393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 158/336] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:53 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:54.253959 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:54.255228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:54.290280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:54.290805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:54.291666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:54.292251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:54.956897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:54.973609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-25e727fd-3209-4b23-9931-01e949e2567d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1514 microversion: 2.1 time: 0.721246 Jan 19 01:00:54.975610 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 159/337] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:54 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1514 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:54.984638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:54.986910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:55.001026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.002172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.003940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.006511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.365545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:00:55.367290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:00:55.368489 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:00:55.369762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:00:55.370716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:00:55.427262 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.428055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.429702 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.430507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.508670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Getting quotas for project b28795d42306497ea73c57f43a3f8798. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:00:55.536457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Getting quotas for user 5e726e75161b4adb818572c02d463fdc and project b28795d42306497ea73c57f43a3f8798. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:00:55.573323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:55.604506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:55.607871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:00:55.612521 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:00:55.630740 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:55.647484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-93ca6652-1852-4220-a56a-c779bb748fc3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.669462 Jan 19 01:00:55.648436 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 160/338] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:00:54 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:00:55.668870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e64c1671-a552-4d63-8f25-6edec276c80c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:55.691129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e64c1671-a552-4d63-8f25-6edec276c80c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.691654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e64c1671-a552-4d63-8f25-6edec276c80c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.762731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ec5ab409-aced-47e4-b0a0-4b44e53b61a2 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107392 Jan 19 01:00:55.765080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 179/339] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:00:55.780114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:55.781925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:55.799318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.811174 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.812995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:55.813862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:55.849663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e64c1671-a552-4d63-8f25-6edec276c80c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Going to try to stop instance {{(pid=116543) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 01:00:55.935693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e64c1671-a552-4d63-8f25-6edec276c80c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 202 len: 0 microversion: 2.1 time: 0.284458 Jan 19 01:00:55.936388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 161/340] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:00:55 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:55.958711 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-aaaa7148-18a8-40df-9fb8-9c5fec701d45 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:55.961683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-aaaa7148-18a8-40df-9fb8-9c5fec701d45 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:56.331013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-aaaa7148-18a8-40df-9fb8-9c5fec701d45 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:56.355227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-aaaa7148-18a8-40df-9fb8-9c5fec701d45 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1214 microversion: 2.1 time: 0.416751 Jan 19 01:00:56.362282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 162/341] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:55 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:56.383401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:56.384542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:56.409042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:56.421489 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.438699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:56.440144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.440929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:56.482085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-954c922d-b126-4242-9b41-c97d992b69d1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1507 microversion: 2.1 time: 0.714614 Jan 19 01:00:56.488661 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 180/342] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:55 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1507 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:56.523987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32af780b-52b5-452c-9a57-445537cbfacd"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:56.526516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:56.557199 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.558630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:56.563593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.577889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:56.838821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Invalid volume: volume 32af780b-52b5-452c-9a57-445537cbfacd is already attached to instances: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd Jan 19 01:00:56.839896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 400 to user: Invalid volume: volume 32af780b-52b5-452c-9a57-445537cbfacd is already attached to instances: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:00:56.841484 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5d1c802c-2a29-43c8-bc81-54a8a2fc8b9b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.327741 Jan 19 01:00:56.863277 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 181/343] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:00:56 2022] POST /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829/os-volume_attachments => generated 174 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:00:56.900341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:56.901730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:56.929300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.930509 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:56.932043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:56.933124 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:57.083092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:57.121505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a485d1f1-ed3f-43af-940f-38072d4a0d44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 0.757871 Jan 19 01:00:57.122154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 163/344] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:56 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:57.132261 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:57.138076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:57.180617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:57.181818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:57.191324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:57.201745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:57.511388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:57.521463 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-91f0e226-f216-4d96-938c-25d63643b190 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1514 microversion: 2.1 time: 0.393124 Jan 19 01:00:57.533597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 164/345] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:57 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:57.533597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:57.533597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:57.560575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:57.571759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:57.572658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:57.573185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:57.914198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lazy-loading 'services' on Instance uuid 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:00:58.270511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6ac7d63c-b09a-4a79-9780-9278eb4fe198 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments/32af780b-52b5-452c-9a57-445537cbfacd" status: 202 len: 0 microversion: 2.1 time: 0.745294 Jan 19 01:00:58.271855 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 165/346] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:00:57 2022] DELETE /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments/32af780b-52b5-452c-9a57-445537cbfacd => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:00:58.291667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:58.301848 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:58.316050 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.319800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:58.323155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.325456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:58.467830 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:58.479828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:58.491197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:58.494911 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ccd01597-08d5-4ba6-9bcb-3e270eb02fae tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 1.628227 Jan 19 01:00:58.496886 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 182/347] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:00:56 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:00:58.508643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccddbd8e-d23e-4b61-aa8a-e8dbc81bde95"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:00:58.516532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:58.534335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.534806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:58.539997 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.540592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:58.644093 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:58.659648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1d7763ad-0866-4c6b-8701-743be461587c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1274 microversion: 2.1 time: 0.382048 Jan 19 01:00:58.661656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 166/348] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:58 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1274 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:58.667490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:58.668509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:58.679392 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.680250 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:58.681396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:58.682029 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.189904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5b4e6e67-3ae1-45e6-97b5-4f19679b46eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690565 Jan 19 01:00:59.191654 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 183/349] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:00:58 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:59.202354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:59.205929 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:59.222064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.226056 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.227636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.230487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.360958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-14bd7314-06ab-4418-aade-a19ef3c0ae5a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166482 Jan 19 01:00:59.362039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 184/350] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:00:59 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:00:59.454665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:59.475654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6450b1b1-6d66-4bb9-b537-d58ce0f2af38 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 0.812099 Jan 19 01:00:59.502278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 167/351] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:58 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:00:59.518868 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:59.520764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:59.538897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.539662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.545531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.546468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.692267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:00:59.693427 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:00:59.719157 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.719945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.721446 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:00:59.722328 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:00:59.922106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:00:59.957395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-59a0f818-1da5-48c8-b7cd-599429f92847 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1272 microversion: 2.1 time: 0.270484 Jan 19 01:00:59.987390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 168/352] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:00:59 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:00.380622 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:00.383633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:00.404586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:00.410823 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:00.419074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:00.423482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:00.515857 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:00.564100 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:00.578148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:00.584455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d2906314-b389-4991-b08b-2a4bd7770f71 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 1.069238 Jan 19 01:01:00.590232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 185/353] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:00:59 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:00.619967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:00.621861 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-97521a84-c75c-4f29-8eee-77f6f88268f7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.241541 Jan 19 01:01:00.624549 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:00.626080 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 169/354] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:01:00 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd/os-volume_attachments => generated 25 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 01:01:00.664584 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:00.668577 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:00.670759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:00.676973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:00.989436 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:00.990431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:01.005297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:01.008906 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:01.012725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:01.016146 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:01.325288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:01.358075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f758adc7-5eb7-4e71-bfa1-6a856b90259b tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1272 microversion: 2.1 time: 0.372987 Jan 19 01:01:01.358701 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 170/355] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:00 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:01.384183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1552640634", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "a5df2d14-6c77-4859-a21d-41a9de91756c"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:01.552413 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] validate_networks() for [('a5df2d14-6c77-4859-a21d-41a9de91756c', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:01:02.059243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:02.090735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-14d4101a-16c9-4ab3-9e58-b9bc4983df19 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 1.497688 Jan 19 01:01:02.114231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 186/356] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:00 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:02.118954 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:02.119429 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:02.134296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.135889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.137809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.138980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.701907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:01:02.706521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:01:02.711199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:01:02.712842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:01:02.714453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:01:02.764202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.765661 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:02.766381 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.768772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.770924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.781829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:02.783466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:02.784732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-190ad726-4ccc-4c1e-97ef-604eb3b27f7c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.669995 Jan 19 01:01:02.785361 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 187/357] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:02 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:02.803199 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:02.803814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:02.823973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.824188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:02.825352 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.826451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:02.827128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:02.850672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for user b46dddae0c2347d399239aaee9b2c486 and project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:02.892960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:01:02.896968 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:01:03.004777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-927d76e7-348e-4d75-bd52-f90a0c9ada85 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641927 Jan 19 01:01:03.011951 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 171/358] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:01:03.018270 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9a9960a4-b326-4d18-8cd1-6fc2145d4313 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:03.019254 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9a9960a4-b326-4d18-8cd1-6fc2145d4313 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:03.115063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9a9960a4-b326-4d18-8cd1-6fc2145d4313 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:03.122779 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9a9960a4-b326-4d18-8cd1-6fc2145d4313 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1218 microversion: 2.1 time: 0.109321 Jan 19 01:01:03.134643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 172/359] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:03 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:03.140262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2010033662", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "8550cd25-1ac0-43a3-a265-8e2a1781782d"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:03.232062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] validate_networks() for [('8550cd25-1ac0-43a3-a265-8e2a1781782d', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:01:03.798843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:03.831832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bf54fd0d-0e2f-4d6f-b861-e35f00cb92c8 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 1.027975 Jan 19 01:01:03.836386 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 188/360] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:02 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:03.844895 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:03.845516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:03.890217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:03.894679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:03.902253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:03.906837 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.529432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:01:04.530111 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:01:04.530352 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:01:04.530758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:01:04.531228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:01:04.548588 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.563936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.565101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.565621 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.609786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Getting quotas for project ac73f1c040f94f43bcdd01f92771821e. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:04.620059 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Getting quotas for user 5a52500125c44ab5a9ffdb801248f33c and project ac73f1c040f94f43bcdd01f92771821e. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:04.636150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:04.648282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:01:04.650600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:01:04.651645 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-532cb811-eb4e-4b7d-8c1a-4e8b675d145d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 0.813863 Jan 19 01:01:04.652581 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 189/361] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:03 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:04.657254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:04.657895 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:04.678507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.678968 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.679806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.680254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.787967 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-32b7ab73-4192-48ec-87cc-03541f492705 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652086 Jan 19 01:01:04.788682 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 173/362] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:01:04.807229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:04.807928 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:04.827340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.827800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:04.828618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:04.829061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:05.103774 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.124925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e9aba2da-0bfa-466e-856e-bede64d2f1fa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1270 microversion: 2.1 time: 0.334557 Jan 19 01:01:05.149877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 174/363] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:04 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1270 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:05.168188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7a317a05-9ba0-43ba-848f-227758a6e1bf tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:05.172105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7a317a05-9ba0-43ba-848f-227758a6e1bf tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:05.383088 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7a317a05-9ba0-43ba-848f-227758a6e1bf tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.414279 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7a317a05-9ba0-43ba-848f-227758a6e1bf tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1219 microversion: 2.1 time: 0.260582 Jan 19 01:01:05.420961 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 175/364] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:05 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:05.447072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:05.449364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:05.471406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:05.472234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:05.475195 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:05.477319 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:05.756432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.771049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9dca98d2-b316-4c3a-8bb3-569bd780096c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 0.348470 Jan 19 01:01:05.772849 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 176/365] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:05 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:05.785702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:05.786743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:05.796444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:05.798162 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:05.804288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:05.814431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:05.889606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.898788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.912416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:05.915855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e32cf724-24ae-4773-8521-3e4999943be2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 1.262190 Jan 19 01:01:05.929071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 190/366] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:04 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:06.119975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:06.130286 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c4c021a4-ea1f-410b-9a26-9d6c198de90f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 0.356046 Jan 19 01:01:06.131696 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 177/367] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:05 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:06.151621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:06.152257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:06.160742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.161963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.163043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.163648 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.288148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:06.296879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5829e7bd-b3da-47e9-adbb-e102aa5982e2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1276 microversion: 2.1 time: 0.149047 Jan 19 01:01:06.308946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 191/368] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:06 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:06.357244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-ebfb2d58-fa88-42f9-8832-63c7afc1c580 req-4111cf4a-322f-4168-9ad4-34c6d80ad363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00326f45-7639-4604-a273-d913175ac466", "tag": "8935c539-370f-4cac-b723-00cad220b862"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:06.359060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:06.359060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:01:06.369107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-ebfb2d58-fa88-42f9-8832-63c7afc1c580 req-4111cf4a-322f-4168-9ad4-34c6d80ad363 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.369651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-ebfb2d58-fa88-42f9-8832-63c7afc1c580 req-4111cf4a-322f-4168-9ad4-34c6d80ad363 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.404994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-ebfb2d58-fa88-42f9-8832-63c7afc1c580 req-4111cf4a-322f-4168-9ad4-34c6d80ad363 service nova] Creating event network-changed:8935c539-370f-4cac-b723-00cad220b862 for instance 00326f45-7639-4604-a273-d913175ac466 on hv-cinder-79987 Jan 19 01:01:06.438073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:06.438711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:06.448160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-ebfb2d58-fa88-42f9-8832-63c7afc1c580 req-4111cf4a-322f-4168-9ad4-34c6d80ad363 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094357 Jan 19 01:01:06.451371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.453519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 178/369] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:01:06.454245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.455115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.455569 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.795023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:06.800585 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:06.831529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.833371 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.835448 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.838846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.931807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:06.942995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8c9aab15-a0ef-46cc-a7aa-4e1c3e18b819 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1271 microversion: 2.1 time: 0.513454 Jan 19 01:01:06.962148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 192/370] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:06 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1271 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:06.982806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:06.983902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:06.996302 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:06.997214 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:06.998741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:07.000383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:07.931367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:07.981365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cf5498b4-697e-44b5-97c2-1b3b90db1c5c tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 1.189672 Jan 19 01:01:07.989920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 179/371] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:06 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:08.007000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:08.008523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:08.014862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:08.016819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:08.029974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:08.031246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.031625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3cd77a87-c523-49a1-b0bb-bd526c4dde9e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1745 microversion: 2.20 time: 1.061053 Jan 19 01:01:08.037847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 193/372] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:06 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1745 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:08.046524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:08.047251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:08.065982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.067105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.069016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.073289 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.074939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.081047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.082493 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.575586 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:08.587695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cc1b4c97-981d-4539-8bc7-c5552f584ce4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 0.548280 Jan 19 01:01:08.588315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 194/373] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:08 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:08.594726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:08.595850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:08.607273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.607737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.608555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:08.610267 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:08.754103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'flavor' on Instance uuid b1e02678-2973-4080-be5a-b589dd630ec9 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:01:09.283005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-eb81fc7a-23ad-4ee1-91ba-6491452ea0eb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action" status: 200 len: 32 microversion: 2.1 time: 0.691702 Jan 19 01:01:09.286612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 195/374] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:01:08 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action => generated 32 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:01:09.315803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:09.317627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:09.372539 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:09.373407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:09.374918 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:09.375534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:09.893019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:09.907351 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6a12cdd2-f013-4292-a15b-30957076d260 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 1.914718 Jan 19 01:01:09.908310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 180/375] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:07 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:09.935154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:09.936131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:09.955915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:09.960921 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:09.971767 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:09.973403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:10.557511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:10.573822 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1353c65e-5071-4910-a8dc-481a03dec923 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 1.283716 Jan 19 01:01:10.575770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 196/376] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:09 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:10.594202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:10.594895 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:10.611757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:10.612224 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:10.621001 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:10.621361 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:11.213614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:11.230856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-451f06e7-4d31-4689-87cf-11225dd0418e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 1.304204 Jan 19 01:01:11.242329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 181/377] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:09 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:11.249681 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:11.270589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:11.290816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:11.296875 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:11.298665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:11.308142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:12.259007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:12.296831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:12.298495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:12.300918 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c4194cc2-1e6f-4868-85f1-c81a9d33d768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 1.723934 Jan 19 01:01:12.313242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 197/378] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:10 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:12.318654 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:12.319290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:12.326865 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:12.327323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:12.328161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:12.328614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:13.547601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:13.574935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0b0676e6-0ac4-4694-9559-ff1c0cd580ac tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 1.259976 Jan 19 01:01:13.583558 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 198/379] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:12 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:13.600470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:13.604956 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:13.617323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:13.621055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:13.625656 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:13.626370 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:15.026991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:15.066185 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-68e470e2-d6f2-4035-9081-d1f7afd24488 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1719 microversion: 2.1 time: 1.467343 Jan 19 01:01:15.074827 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 199/380] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:13 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1719 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:15.100118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:15.101517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:15.122381 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:15.133853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:15.136049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:15.137283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:15.431041 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:15.450465 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fef15051-c98f-44d5-ac55-0684d5ef2c92 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 4.203694 Jan 19 01:01:15.454577 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 182/381] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:11 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 4211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:15.473989 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:15.479959 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:15.487580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:15.488710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:15.489908 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:15.496840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:16.684605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:16.699490 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f0ac62ea-0ae0-48f2-953c-bb97078c9514 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 1.622907 Jan 19 01:01:16.716239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 200/382] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:15 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:16.722130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-0b929a4c-1c59-48dd-9590-b921f85b7397 req-07016508-9b8c-4752-bfe4-4fa907c53295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e12597-7db9-4c72-adc8-20270f7474f4", "tag": "2af8b39b-1fd3-486d-b078-83ad1b5e7a78"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:16.742662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:16.742662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:01:16.773449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0b929a4c-1c59-48dd-9590-b921f85b7397 req-07016508-9b8c-4752-bfe4-4fa907c53295 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:16.774257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0b929a4c-1c59-48dd-9590-b921f85b7397 req-07016508-9b8c-4752-bfe4-4fa907c53295 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:16.820369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-0b929a4c-1c59-48dd-9590-b921f85b7397 req-07016508-9b8c-4752-bfe4-4fa907c53295 service nova] Creating event network-changed:2af8b39b-1fd3-486d-b078-83ad1b5e7a78 for instance f9e12597-7db9-4c72-adc8-20270f7474f4 on hv-cinder-79987 Jan 19 01:01:16.861281 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-0b929a4c-1c59-48dd-9590-b921f85b7397 req-07016508-9b8c-4752-bfe4-4fa907c53295 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143355 Jan 19 01:01:16.862202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 201/383] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:16.872693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:16.883087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:16.895436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:16.896314 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:16.897433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:16.898182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:17.348781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:17.386037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ed9bdf56-34ff-4307-b3a0-a1951c759a41 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 1.926226 Jan 19 01:01:17.397478 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 183/384] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:15 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:17.406636 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:17.415408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:17.446018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:17.451217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:17.453237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:17.454451 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:17.589290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:17.601528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:17.609676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:17.621303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d8808fbe-cd01-48d0-bc24-2bcdc0dd376e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 0.757600 Jan 19 01:01:17.624862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 202/385] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:16 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:17.630225 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:17.638530 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:17.659248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:17.664500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:17.672083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:17.678730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:18.267715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:18.285883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a753aaac-efa8-40d4-992a-584529184d0b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1696 microversion: 2.1 time: 0.659620 Jan 19 01:01:18.291460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 203/386] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:17 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1696 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:18.303130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:18.307565 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:18.351500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:18.357985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:18.375221 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:18.376546 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:18.861457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:18.875949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2e91bbc6-41b5-405d-99d2-f488ee8dc679 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.580947 Jan 19 01:01:18.879561 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 204/387] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:18 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:18.887683 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:18.893900 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:18.903394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:18.916723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:18.918240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:18.921172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:18.929002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:18.943015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-90c8ff35-2593-49bf-bf8e-e8833da73d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 1.542991 Jan 19 01:01:18.958989 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 184/388] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:17 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:18.979973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-1aaed49e-b63a-4902-aca3-34109d97e731 req-6d905935-8def-49a8-88de-a6901fde89aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca39699-5b1c-41e3-8fbe-4b914265d69f", "tag": "5f884301-077e-4a7e-abc4-146c5797b4ca"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:18.983829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:18.983829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:01:19.016764 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-1aaed49e-b63a-4902-aca3-34109d97e731 req-6d905935-8def-49a8-88de-a6901fde89aa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.018900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-1aaed49e-b63a-4902-aca3-34109d97e731 req-6d905935-8def-49a8-88de-a6901fde89aa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:19.106675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-1aaed49e-b63a-4902-aca3-34109d97e731 req-6d905935-8def-49a8-88de-a6901fde89aa service nova] Creating event network-changed:5f884301-077e-4a7e-abc4-146c5797b4ca for instance aca39699-5b1c-41e3-8fbe-4b914265d69f on hv-cinder-79987 Jan 19 01:01:19.114336 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-1aaed49e-b63a-4902-aca3-34109d97e731 req-6d905935-8def-49a8-88de-a6901fde89aa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153616 Jan 19 01:01:19.115299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 185/389] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:19.121184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1c0e8ae7-e041-4ce2-afda-778317ac52dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:19.128805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c0e8ae7-e041-4ce2-afda-778317ac52dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.129286 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1c0e8ae7-e041-4ce2-afda-778317ac52dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:19.196795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1c0e8ae7-e041-4ce2-afda-778317ac52dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Going to try to start instance {{(pid=116543) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 01:01:19.379644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1c0e8ae7-e041-4ce2-afda-778317ac52dc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 202 len: 0 microversion: 2.1 time: 0.262168 Jan 19 01:01:19.383831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 186/390] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:01:19 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:01:19.407810 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:19.409154 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:19.457222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.458172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:19.460290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.485514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:19.654461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:19.700040 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-acd9dd7e-951d-4642-a2ca-632533103bf0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.815974 Jan 19 01:01:19.704072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 205/391] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:18 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:19.711714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:19.712949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:19.727538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.728855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:19.730740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:19.731950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:20.395825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:20.403995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-80133b13-98de-4166-af25-bafc2bd974b3 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 1.016915 Jan 19 01:01:20.404607 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 187/392] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:19 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:20.427051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-d24d2af2-635d-4dbd-8d83-d464167821fe req-f1092551-d06f-4ba4-94ec-54ac376c13c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "name": "network-vif-plugged", "status": "completed", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:20.430960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:20.430960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:01:20.469533 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d24d2af2-635d-4dbd-8d83-d464167821fe req-f1092551-d06f-4ba4-94ec-54ac376c13c0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:20.475079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d24d2af2-635d-4dbd-8d83-d464167821fe req-f1092551-d06f-4ba4-94ec-54ac376c13c0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:20.509138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-d24d2af2-635d-4dbd-8d83-d464167821fe req-f1092551-d06f-4ba4-94ec-54ac376c13c0 service nova] Creating event network-vif-plugged:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 01:01:20.526353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-d24d2af2-635d-4dbd-8d83-d464167821fe req-f1092551-d06f-4ba4-94ec-54ac376c13c0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114648 Jan 19 01:01:20.533595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 188/393] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:20.542439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:20.545136 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:20.562161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:20.562985 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:20.565799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:20.570024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:20.692603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:20.705684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:20.716757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:20.718060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fd976b39-a530-47d0-94b5-b26df088fbcc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 1.011807 Jan 19 01:01:20.729618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 206/394] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:19 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:20.746616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:20.750150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:20.767206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:20.779112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:20.782458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:20.785223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:21.364130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:21.379077 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-43070778-4492-4b91-bd88-7fe9e5256095 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1705 microversion: 2.1 time: 0.843279 Jan 19 01:01:21.387210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 189/395] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:20 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1705 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:21.408214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:21.418500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:21.439354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:21.440127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:21.442095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:21.451276 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:21.940976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:21.957721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-aef8c366-fc8c-45f2-89de-8afc36915943 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 1.227100 Jan 19 01:01:21.971307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 207/396] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:20 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:21.984948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:21.985602 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:22.015619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.016150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.017019 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.017471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.245853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:22.258572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-debe6f2e-21c3-4cd5-ba75-bd8616be9446 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 0.869946 Jan 19 01:01:22.259580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 190/397] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:21 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:22.266938 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:22.274969 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:22.296287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.296764 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.297760 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.298217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.459598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:22.474023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ab008030-04b7-4425-8d13-a11a77898ba4 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.498638 Jan 19 01:01:22.474936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 208/398] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:21 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:22.486587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:22.491783 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:22.506665 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.508943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.514591 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.515425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.897002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:22.913675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b8601f99-d058-4af9-918a-94a3869128c5 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 0.652597 Jan 19 01:01:22.926138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 191/399] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:22 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:22.932757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:22.933444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:22.941137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.941512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:22.942426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:22.942971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:23.430619 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:23.459068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ab05b1c4-e145-46dd-a87c-24db05814933 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1705 microversion: 2.1 time: 0.521711 Jan 19 01:01:23.464979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 192/400] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:22 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1705 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:23.481367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-5bcef3a9-e756-41c5-90a0-ba6020b8f55b req-afdacd13-d000-472d-b8bf-18a2fe6019fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00326f45-7639-4604-a273-d913175ac466", "name": "network-vif-plugged", "status": "completed", "tag": "8935c539-370f-4cac-b723-00cad220b862"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:23.483662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:23.483662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:01:23.492901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-5bcef3a9-e756-41c5-90a0-ba6020b8f55b req-afdacd13-d000-472d-b8bf-18a2fe6019fc service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:23.493649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-5bcef3a9-e756-41c5-90a0-ba6020b8f55b req-afdacd13-d000-472d-b8bf-18a2fe6019fc service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:23.504409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:23.509252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-5bcef3a9-e756-41c5-90a0-ba6020b8f55b req-afdacd13-d000-472d-b8bf-18a2fe6019fc service nova] Creating event network-vif-plugged:8935c539-370f-4cac-b723-00cad220b862 for instance 00326f45-7639-4604-a273-d913175ac466 on hv-cinder-79987 Jan 19 01:01:23.515950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-5bcef3a9-e756-41c5-90a0-ba6020b8f55b req-afdacd13-d000-472d-b8bf-18a2fe6019fc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048732 Jan 19 01:01:23.517828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 193/401] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:23.520472 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:23.524433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:23.527366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:23.529448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:23.535508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:23.536707 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:23.537815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:23.538423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:23.541812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c2ca6a8a-a5f3-47b9-b9f9-e511480f2264 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 1.059890 Jan 19 01:01:23.542597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 209/402] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:22 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:23.563804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:23.572410 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:23.590122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:23.592454 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:23.598779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:23.600778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:24.136228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:24.156646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e358eb12-a1cf-48e5-93cf-979ae8a98d0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.635933 Jan 19 01:01:24.172458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 194/403] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:23 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:24.188164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:24.188862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:24.217280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:24.217840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:24.218683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:24.219124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:24.677034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:24.691607 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-352bfad5-b337-43ee-85ad-9bbce469727e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.517993 Jan 19 01:01:24.699211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 195/404] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:24 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:24.714768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:24.715390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:24.758459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:24.758915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:24.759732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:24.760166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.122580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:25.150884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0edba607-3416-45eb-9315-00cb0092c242 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1314 microversion: 2.1 time: 0.449784 Jan 19 01:01:25.152332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 196/405] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:24 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:25.158700 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:25.159687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:25.168106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.169084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.170441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.171081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.472474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:25.481678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8fa2b820-76b8-4191-83c6-69076555a535 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1709 microversion: 2.1 time: 0.328057 Jan 19 01:01:25.505970 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 197/406] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:25 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1709 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:25.549034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:25.551534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:25.590795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.591521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.604600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.605382 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.675802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:25.711175 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6ffe850e-9da3-4b7a-9f7d-955af7dedd11 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 2.166853 Jan 19 01:01:25.718794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 210/407] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:23 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:25.741944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:25.742574 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:25.751842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.752672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:25.754647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:25.770725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:26.074716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:26.098799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:26.107675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:26.125368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b9cb1123-9976-4003-b398-36be44494fec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 0.606755 Jan 19 01:01:26.126265 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 198/408] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:25 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:26.148671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:26.154575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:26.179385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:26.183526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:26.186565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:26.189283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:26.489834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:26.524847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-daf764e3-98aa-4f16-b8b3-3be9ba6be7e2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.803770 Jan 19 01:01:26.539883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 211/409] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:25 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:26.567125 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:26.568264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:26.620341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:26.644452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:26.653891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:26.655423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:26.974480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:26.984429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a58f5af5-cf92-416e-9c37-6cd709b57c30 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.856462 Jan 19 01:01:26.985184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 199/410] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:26 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:26.990709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:26.991843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:26.999781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.000540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:27.002070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.002756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:27.221792 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:27.232876 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-807e8fd3-4efe-4b19-bc12-ecef9e069575 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1497 microversion: 2.1 time: 0.689147 Jan 19 01:01:27.248699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 212/411] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:26 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1497 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:27.261587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:27.270445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:27.292399 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.296902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:27.298047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.300925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:27.432488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:27.462644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-380e5288-1f88-4b2e-a694-4a5d08b1cf94 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 0.475734 Jan 19 01:01:27.469969 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 200/412] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:26 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:27.572431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:27.576044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:27.626593 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.629021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:27.635214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:27.638982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.160400 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:28.178630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2539e0a4-f6d7-4383-95a0-f4b2a9b51f73 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.623694 Jan 19 01:01:28.182487 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 201/413] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:27 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:28.193157 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:28.194243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:28.215021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.218227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.224595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.225445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.495811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:28.507289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:28.509134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:28.510703 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-94e0e1c3-0a39-4f0e-b81e-2db5c4b6e58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 1.260657 Jan 19 01:01:28.513000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 213/414] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:27 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:28.524827 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-3b825d60-7629-4f5c-b33f-f7d96a41182f req-41147fa8-41e1-4efa-aa18-037c2f08474f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e12597-7db9-4c72-adc8-20270f7474f4", "name": "network-vif-plugged", "status": "completed", "tag": "2af8b39b-1fd3-486d-b078-83ad1b5e7a78"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:28.528764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:28.528764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:01:28.546857 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3b825d60-7629-4f5c-b33f-f7d96a41182f req-41147fa8-41e1-4efa-aa18-037c2f08474f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.547723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3b825d60-7629-4f5c-b33f-f7d96a41182f req-41147fa8-41e1-4efa-aa18-037c2f08474f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.571851 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-3b825d60-7629-4f5c-b33f-f7d96a41182f req-41147fa8-41e1-4efa-aa18-037c2f08474f service nova] Creating event network-vif-plugged:2af8b39b-1fd3-486d-b078-83ad1b5e7a78 for instance f9e12597-7db9-4c72-adc8-20270f7474f4 on hv-cinder-79987 Jan 19 01:01:28.585478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-3b825d60-7629-4f5c-b33f-f7d96a41182f req-41147fa8-41e1-4efa-aa18-037c2f08474f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070398 Jan 19 01:01:28.586464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 214/415] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:28.598433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:28.604860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:28.617809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.618225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:28.620803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.621917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.625628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.626678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b284075b-9ff2-439f-b26c-c202694a3b7e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.442771 Jan 19 01:01:28.628139 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 202/416] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:28 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:28.635262 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:28.643091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:28.687103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:01:28.700832 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.701710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:28.703373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:28.717126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:29.006486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d15857ba-5e9a-4ef7-8530-016291ee082e tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "DELETE /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 204 len: 0 microversion: 2.1 time: 0.413250 Jan 19 01:01:29.009263 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 215/417] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:01:28 2022] DELETE /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:01:29.387111 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:29.401049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5b3c72f8-298d-4a89-bf6e-d1c9602a7ce2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 0.771104 Jan 19 01:01:29.402365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 203/418] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:28 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:29.411876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:29.414852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:29.427348 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:29.428505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:29.430127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:29.430800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:29.756016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Action: 'create', calling method: .version_select at 0x7f934c7e08b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1638542336"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:29.764683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:29.783713 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-38095a34-32e8-4cf5-a4ab-fcaa8e129561 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1503 microversion: 2.1 time: 0.377316 Jan 19 01:01:29.788569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 204/419] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:29 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:29.791194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for project 71fc118391b34d35b75c25f76155c402. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:29.796360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for user edbc6d028bae4706b508e2e5580506d4 and project 71fc118391b34d35b75c25f76155c402. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:29.804159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:29.805128 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:29.820070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:29.822386 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:29.825018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:29.826537 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.142694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for project 71fc118391b34d35b75c25f76155c402. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:30.149812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for user edbc6d028bae4706b508e2e5580506d4 and project 71fc118391b34d35b75c25f76155c402. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:30.164862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:30.170386 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9dc927ae-e68d-4087-9bd9-b21bcd972e26 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.156277 Jan 19 01:01:30.173488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 216/420] 10.222.0.35 () {60 vars in 1157 bytes} [Wed Jan 19 01:01:29 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:30.174466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e2ec41b6-e7f5-4b78-b5c1-0847cdb48a44 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.384543 Jan 19 01:01:30.183986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 205/421] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:29 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:30.185461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:30.187391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:30.194579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.195317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.196722 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.197330 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.197597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:30.198729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:30.205424 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.205679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.209097 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.209598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.515024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:30.524398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0bca4652-b32a-4ab9-aada-0fdf69431ac7 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.339161 Jan 19 01:01:30.534069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 206/422] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:30 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:30.539571 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:30.542475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:30.565182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.575191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:30.585516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:30.586214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.587931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.588612 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.592524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:30.603927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ac04f0c4-16e1-45f4-99a0-8458d1bf6401 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 0.421561 Jan 19 01:01:30.629517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 217/423] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:30 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:30.810164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:30.812927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:30.827080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.828010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:30.834000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:30.834839 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:31.008722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:31.031860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2688a240-edc5-4a3e-b1d8-e9f98c528b92 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1318 microversion: 2.1 time: 0.496168 Jan 19 01:01:31.033765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 207/424] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:30 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:31.206130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:31.207047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:31.221328 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:31.223458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:31.225811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:31.226579 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:31.250718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:31.280535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8ad5f33d-aec1-43dc-b558-f26d09228474 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1503 microversion: 2.1 time: 0.474609 Jan 19 01:01:31.281640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 218/425] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:30 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1503 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:31.578409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:31.579787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:31.627004 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:31.628836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:31.633774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:31.634632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:31.979983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:32.063597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ec2cba22-11b2-4720-b6e8-dd488cacd471 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.857209 Jan 19 01:01:32.072226 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 208/426] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:31 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:32.092648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:32.109882 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:32.151375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:32.155535 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:32.157519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:32.165244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:32.253915 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:32.275528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a40180de-30e9-4d03-bfad-7e1c432f78e2 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.723336 Jan 19 01:01:32.276166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 219/427] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:31 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:32.305741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-b069cdc7-1a7e-4bdf-a78d-ceb1e889f9a7 req-ef23dbfe-1b4e-46ec-9287-438f9fe178a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca39699-5b1c-41e3-8fbe-4b914265d69f", "name": "network-vif-plugged", "status": "completed", "tag": "5f884301-077e-4a7e-abc4-146c5797b4ca"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:32.315297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:32.315297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:01:32.328516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-b069cdc7-1a7e-4bdf-a78d-ceb1e889f9a7 req-ef23dbfe-1b4e-46ec-9287-438f9fe178a3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:32.332210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-b069cdc7-1a7e-4bdf-a78d-ceb1e889f9a7 req-ef23dbfe-1b4e-46ec-9287-438f9fe178a3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:32.367962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-b069cdc7-1a7e-4bdf-a78d-ceb1e889f9a7 req-ef23dbfe-1b4e-46ec-9287-438f9fe178a3 service nova] Creating event network-vif-plugged:5f884301-077e-4a7e-abc4-146c5797b4ca for instance aca39699-5b1c-41e3-8fbe-4b914265d69f on hv-cinder-79987 Jan 19 01:01:32.380131 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-b069cdc7-1a7e-4bdf-a78d-ceb1e889f9a7 req-ef23dbfe-1b4e-46ec-9287-438f9fe178a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082297 Jan 19 01:01:32.381229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 220/428] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:32.404049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:32.405359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:32.427037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:32.428149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:32.429256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:32.429966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.409030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:33.422242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9a833346-2a21-4310-8087-1bbae08989dc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1509 microversion: 2.1 time: 1.038317 Jan 19 01:01:33.432408 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 221/429] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:32 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1509 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:33.461847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:33.473757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:33.474825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:33.474969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:33.480025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:33.492482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b1b2de4c-b9ef-4141-a28e-d61e7a558f89 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 1.414661 Jan 19 01:01:33.493080 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 209/430] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:32 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:33.510165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:33.510522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.511386 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:33.518061 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.519603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.520427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.528604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.537715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.542068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.548001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.799046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:33.855557 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5cee596d-2b48-4657-bbd7-5248f082c783 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1461 microversion: 2.1 time: 0.411906 Jan 19 01:01:33.856535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 222/431] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:33 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1461 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:33.892630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:33.894032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:33.933451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.960146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:33.964213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:33.965064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.319983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:34.339068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-60e321ae-248a-4dab-9235-10cc61bae5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.844564 Jan 19 01:01:34.348820 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 210/432] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:33 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:34.357475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-9969a4a7-8222-4386-8c37-b2c6fc302bd9 req-26805a7e-6b16-4bef-b699-a9a69d311026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00326f45-7639-4604-a273-d913175ac466", "name": "network-vif-deleted", "tag": "8935c539-370f-4cac-b723-00cad220b862"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:34.364343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:34.364343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:01:34.376534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-9969a4a7-8222-4386-8c37-b2c6fc302bd9 req-26805a7e-6b16-4bef-b699-a9a69d311026 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:34.382147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-9969a4a7-8222-4386-8c37-b2c6fc302bd9 req-26805a7e-6b16-4bef-b699-a9a69d311026 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.406230 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-9969a4a7-8222-4386-8c37-b2c6fc302bd9 req-26805a7e-6b16-4bef-b699-a9a69d311026 service nova] Creating event network-vif-deleted:8935c539-370f-4cac-b723-00cad220b862 for instance 00326f45-7639-4604-a273-d913175ac466 on hv-cinder-79987 Jan 19 01:01:34.422044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-9969a4a7-8222-4386-8c37-b2c6fc302bd9 req-26805a7e-6b16-4bef-b699-a9a69d311026 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071411 Jan 19 01:01:34.428690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 211/433] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:34.536873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:34.538049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:34.538982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:34.560338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:34.566039 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.568932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:34.569453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.570898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2ad8376c-10f9-494d-a9d8-8b12168202f0 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1319 microversion: 2.1 time: 0.702348 Jan 19 01:01:34.571720 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 223/434] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:33 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:34.873741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:34.874451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:34.895006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:34.899348 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.900453 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:34.901905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:34.969217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:35.007144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:35.016981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:35.019953 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-aa9229e2-b4d7-4fec-a580-afd71da903c0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 0.489567 Jan 19 01:01:35.023353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 212/435] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:34 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:35.088969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:35.094596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:35.097504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lazy-loading 'fault' on Instance uuid 00326f45-7639-4604-a273-d913175ac466 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:01:35.186022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e726e75161b4adb818572c02d463fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28795d42306497ea73c57f43a3f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:35.203118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b8439c83-46e7-49b7-87a6-7dad1efcc4d0 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 200 len: 1304 microversion: 2.1 time: 0.332997 Jan 19 01:01:35.205359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 224/436] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:34 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 1304 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:35.367495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:35.369433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:35.389110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:35.389669 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:35.394378 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf4966e-4c5c-4d9f-a1c0-d03789f23067"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:35.395924 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:35.401039 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:35.402402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:35.410335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:35.411671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:35.414159 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:35.415382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:35.830616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:35.846213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-487c7667-fba0-4049-aa73-082eeeac8c10 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.483254 Jan 19 01:01:35.849002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 213/437] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:35 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:35.852679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'create', calling method: .version_select at 0x7f934c88fa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-451802842"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:35.911646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for project 57a740c1bb3e424287752ebd823d57ec. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:35.928293 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for user 4ca01c95ab3c43cea84100055c870366 and project 57a740c1bb3e424287752ebd823d57ec. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:36.017715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e769ebe1-5ae8-42f1-a680-33e098245163 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627959 Jan 19 01:01:36.018881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 225/438] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:01:35 2022] POST /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:36.027733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:36.028471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:36.047156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.047934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.048966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.051831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.414342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:36.424555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-705e474d-2bec-415e-ba95-511337600484 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1509 microversion: 2.1 time: 0.404127 Jan 19 01:01:36.440520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 226/439] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:36 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:36.454457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:36.456942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:36.490517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.491304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.492805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.493644 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.497510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for project 57a740c1bb3e424287752ebd823d57ec. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:36.510147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for user 4ca01c95ab3c43cea84100055c870366 and project 57a740c1bb3e424287752ebd823d57ec. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:36.560213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2f303b05-7a00-4476-a44b-f76558c27763 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.710919 Jan 19 01:01:36.562278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 214/440] 10.222.0.35 () {60 vars in 1157 bytes} [Wed Jan 19 01:01:35 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:36.581253 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:36.591311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] [instance: 00326f45-7639-4604-a273-d913175ac466] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:36.627029 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.627759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.632768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.637614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.684589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] HTTP exception thrown: Instance 00326f45-7639-4604-a273-d913175ac466 could not be found. Jan 19 01:01:36.686251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] Returning 404 to user: Instance 00326f45-7639-4604-a273-d913175ac466 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:01:36.688369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1d3a53d8-365d-4efe-9167-e7d4e57e93c1 tempest-VolumesActionsTest-801047513 tempest-VolumesActionsTest-801047513-project] 10.222.0.35 "GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466" status: 404 len: 111 microversion: 2.1 time: 0.123678 Jan 19 01:01:36.698915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 215/441] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:36 2022] GET /compute/v2.1/servers/00326f45-7639-4604-a273-d913175ac466 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:01:36.707502 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-825130437", "imageRef": "5d35d095-892e-446c-92c6-1ff3bc45f301", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-451802842", "networks": [{"uuid": "ff8e0595-15d9-4c18-9a0d-ea7c9fab1d4a"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:36.816166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] validate_networks() for [('ff8e0595-15d9-4c18-9a0d-ea7c9fab1d4a', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:01:36.830692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:36.847812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:36.851277 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:36.858638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9b26322d-8068-4c2e-9b88-47c5ba673f18 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1740 microversion: 2.20 time: 0.416351 Jan 19 01:01:36.860601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 227/442] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:36 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:36.885496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:36.887284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:36.900112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.901139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:36.902931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:36.903933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:37.304938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:37.322825 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-56eab74a-c5e3-4898-8ad9-7378ebba414c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.442954 Jan 19 01:01:37.325127 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 228/443] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:36 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:37.884444 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:37.886266 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:37.914774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:37.915358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:37.916643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:37.917349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:38.015790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:01:38.016361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:01:38.016606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:01:38.017191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:01:38.017945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:01:38.038863 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:38.044602 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:38.045609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:38.046284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:38.089858 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for project 57a740c1bb3e424287752ebd823d57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:38.116765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Getting quotas for user 4ca01c95ab3c43cea84100055c870366 and project 57a740c1bb3e424287752ebd823d57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:38.172766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:01:38.175989 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d35d095-892e-446c-92c6-1ff3bc45f301',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:01:38.184403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:38.192809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:38.194416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:38.195647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1b84e728-90d7-40e5-b39c-72ff3ac21090 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1722 microversion: 2.20 time: 0.319147 Jan 19 01:01:38.210296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 229/444] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:37 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:38.249266 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6244062e-f55e-4438-8d4a-2473839636bf tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548562 Jan 19 01:01:38.250129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 216/445] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:01:38.262985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-81304f69-f5ed-474d-823b-56c6af4b0a3f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:38.263978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-81304f69-f5ed-474d-823b-56c6af4b0a3f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:38.348743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:38.349951 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:38.363633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:38.364468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:38.366344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:38.368943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:38.432207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-81304f69-f5ed-474d-823b-56c6af4b0a3f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:38.445148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-81304f69-f5ed-474d-823b-56c6af4b0a3f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1257 microversion: 2.1 time: 0.185537 Jan 19 01:01:38.446183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 230/446] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:38 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1257 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:38.723991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:38.733876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-00427b54-0c00-48c3-803e-1d2762cb1399 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.394339 Jan 19 01:01:38.734404 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 217/447] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:38 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:39.230503 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:39.231076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:39.241854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.242337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:39.243180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.243630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:39.441066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:39.451108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:39.452612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:39.453854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8cb9355a-5bd8-49c0-b640-ea102eaaa678 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1722 microversion: 2.20 time: 0.227603 Jan 19 01:01:39.454424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 231/448] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:39 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:39.464474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:39.465517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:39.473505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.474015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:39.474841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.475283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:39.552920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:39.561028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-63a82384-2fcc-4dd1-b489-40d121d946fc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1309 microversion: 2.1 time: 0.101470 Jan 19 01:01:39.561943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 218/449] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:39 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:39.760178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:39.760711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:39.767147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.767612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:39.768431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:39.768879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:40.005235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:40.024542 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3770a7b5-8d6f-4275-9d53-bfd73dc1a011 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.267624 Jan 19 01:01:40.025617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 232/450] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:39 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:40.476759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:40.477488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:40.487943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:40.488725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:40.490214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:40.491019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:40.580118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:40.583380 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:40.594615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:40.595557 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:40.596437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:40.597642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:40.692994 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:40.702251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-010d6e92-b110-4640-b2e5-21044fa9b491 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1315 microversion: 2.1 time: 0.126724 Jan 19 01:01:40.712118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 233/451] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:40 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:40.772815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:40.782703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:40.784507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:40.785960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-20956c37-9cc3-44c5-99a6-986fddd5e018 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1722 microversion: 2.20 time: 0.314667 Jan 19 01:01:40.786923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 219/452] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:40 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:41.016626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-39dcea15-a3f6-4fa3-a12f-0ebbc91596bb req-a7d978e5-19e6-4947-bad1-bd01dd7625cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "name": "network-vif-unplugged", "status": "completed", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:41.019113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:41.019113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:01:41.027280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-39dcea15-a3f6-4fa3-a12f-0ebbc91596bb req-a7d978e5-19e6-4947-bad1-bd01dd7625cb service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.028015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-39dcea15-a3f6-4fa3-a12f-0ebbc91596bb req-a7d978e5-19e6-4947-bad1-bd01dd7625cb service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.041917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-39dcea15-a3f6-4fa3-a12f-0ebbc91596bb req-a7d978e5-19e6-4947-bad1-bd01dd7625cb service nova] Creating event network-vif-unplugged:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 01:01:41.048138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-39dcea15-a3f6-4fa3-a12f-0ebbc91596bb req-a7d978e5-19e6-4947-bad1-bd01dd7625cb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035563 Jan 19 01:01:41.049395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 234/453] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:41.058080 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:41.059765 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:41.075630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.076189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.077429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.078159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.429639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:41.451824 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4379e67b-da91-4821-ae77-50feb2268d8d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.404169 Jan 19 01:01:41.453006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 220/454] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:41 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:41.736718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:41.738057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:41.760801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.761658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.763359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.764353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.820048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:41.822218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:41.839409 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.840717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:41.842470 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:41.843527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:42.117764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:42.130343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-82f0001f-ecd0-4c72-8405-faec1bbe95f9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.406247 Jan 19 01:01:42.130970 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 235/455] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:41 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:42.261170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-402be54a-271e-4512-8897-b324d4e738e6 req-dcdfd190-48f7-4a53-a874-1daecf7a4847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:42.265354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:01:42.265354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:01:42.277225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:42.285497 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-402be54a-271e-4512-8897-b324d4e738e6 req-dcdfd190-48f7-4a53-a874-1daecf7a4847 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:42.288795 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-402be54a-271e-4512-8897-b324d4e738e6 req-dcdfd190-48f7-4a53-a874-1daecf7a4847 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:42.303545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:42.307170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:42.308852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1cdede32-6c49-48c2-8dde-e271521ebfce tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1722 microversion: 2.20 time: 0.494914 Jan 19 01:01:42.314476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-402be54a-271e-4512-8897-b324d4e738e6 req-dcdfd190-48f7-4a53-a874-1daecf7a4847 service nova] Creating event network-changed:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:01:42.321087 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 221/456] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:41 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:42.325147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-402be54a-271e-4512-8897-b324d4e738e6 req-dcdfd190-48f7-4a53-a874-1daecf7a4847 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079282 Jan 19 01:01:42.332612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 236/457] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:42.474147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:42.475305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:42.490312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:42.491254 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:42.500896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:42.502364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:42.770037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:42.779507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-89acddfa-f7d8-4f5d-91ff-2954cd387de3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.312799 Jan 19 01:01:42.780377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 222/458] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:42 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:43.157533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:43.158246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:43.168479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.169697 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.171501 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.172379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.328356 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:43.329247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:43.336599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.337059 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.339821 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.342597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.369121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:43.382249 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-682553ad-d943-48b1-98ae-aabb68110c66 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.229721 Jan 19 01:01:43.383205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 237/459] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:43 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:43.648829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:43.665872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:43.668127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:43.669428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-63747f7f-c665-45d6-a6ab-d36defbe8fc7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1665 microversion: 2.20 time: 0.344941 Jan 19 01:01:43.670634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 223/460] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:43 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1665 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:43.700989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48baeb7d-6f4b-4dfa-b135-cdaa4a6c2fa0"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:43.702150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:43.709043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.709487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.710333 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.710771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.813129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:43.814795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:43.828027 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.828940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:43.830747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:43.831889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.028987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:44.038500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-492f76f5-ff23-421e-8bfa-525f41779b52 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.229552 Jan 19 01:01:44.039106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 224/461] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:43 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:44.243177 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c54e581a-bd33-48d3-b762-874cc301fd83 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.547143 Jan 19 01:01:44.251912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 238/462] 10.222.0.35 () {62 vars in 1363 bytes} [Wed Jan 19 01:01:43 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 188 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:01:44.406241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:44.407360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:44.420704 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.421737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.423126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.424010 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.481203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:44.482306 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:44.495478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.496107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.496986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.497422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.618905 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:44.625711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-36725373-e3e9-4238-a496-0fcec99d198b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action" status: 202 len: 0 microversion: 2.20 time: 0.152783 Jan 19 01:01:44.630156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 239/463] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:01:44 2022] POST /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:01:44.636017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9c1d595d-168c-4279-bcb9-512451d3f011 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.238617 Jan 19 01:01:44.639385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 225/464] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:44 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:44.649063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:44.649724 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:44.656538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.657000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.658304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:44.658304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:44.830084 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:44.839742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:44.841265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:44.842511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-920fa47a-57fb-463a-bdfe-bfe8f5ffde2d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.210176 Jan 19 01:01:44.843094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 240/465] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:44 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:45.057229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:45.057869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.065724 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.066493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.067656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.068139 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.129201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf4966e-4c5c-4d9f-a1c0-d03789f23067"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:45.130530 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.136748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.137197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.138025 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.138451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.234155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Invalid volume: volume acf4966e-4c5c-4d9f-a1c0-d03789f23067 is already attached to instances: f9e12597-7db9-4c72-adc8-20270f7474f4 Jan 19 01:01:45.234772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 400 to user: Invalid volume: volume acf4966e-4c5c-4d9f-a1c0-d03789f23067 is already attached to instances: f9e12597-7db9-4c72-adc8-20270f7474f4 {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:01:45.235636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bde13555-72e7-414a-a5f1-4438a6c5c7be tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111186 Jan 19 01:01:45.236244 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 241/466] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:01:45 2022] POST /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 19 01:01:45.277638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:45.289751 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-43016648-00ce-4410-baea-d198f0c7c2f7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.236085 Jan 19 01:01:45.290585 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 226/467] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:45 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:45.326012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:45.326642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.336723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.337525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.339000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.339843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.547385 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lazy-loading 'services' on Instance uuid f9e12597-7db9-4c72-adc8-20270f7474f4 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:01:45.669869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:45.671165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.680024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.680676 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.681766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.682345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.754936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ef9cd3c8-6b4c-4616-b577-6fa653f7ea8a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments/acf4966e-4c5c-4d9f-a1c0-d03789f23067" status: 202 len: 0 microversion: 2.1 time: 0.432275 Jan 19 01:01:45.756042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 242/468] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:01:45 2022] DELETE /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments/acf4966e-4c5c-4d9f-a1c0-d03789f23067 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:01:45.778804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:45.781800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.793675 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.794381 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.795737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.796508 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.850551 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b56e4d25-1eee-48e2-aae6-eb4d60849f33 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088436 Jan 19 01:01:45.851185 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 243/469] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:01:45 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:45.875042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:45.876129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:45.889582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.890292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.891710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:45.892359 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:45.908090 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:45.921224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-07f1d984-af74-4cee-9a7b-aa8671670f0a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.258758 Jan 19 01:01:45.922247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 227/470] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:45 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:46.106593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:46.116836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:46.119065 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:46.120512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c7b38161-1046-471c-b4c9-1f8e375ee481 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.252866 Jan 19 01:01:46.122824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 244/471] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:45 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:46.308323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:46.308941 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:46.315757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.316207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:46.317015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.317453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:46.471675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:46.481140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7345005e-c1e1-4ed9-98c8-32a0d280f5bc tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.176474 Jan 19 01:01:46.481773 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 228/472] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:46 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:46.870246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:46.871897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:46.883969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.884905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:46.886322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.887108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:46.933658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5700427d-c2fc-48c8-bc10-7407ca37e3f1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071872 Jan 19 01:01:46.940540 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 245/473] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:01:46 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:01:46.952062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:46.954356 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:46.968849 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.969881 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:46.972151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:46.973198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.140397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:47.141909 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:47.151526 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.152093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.152979 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.153425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.201085 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:47.215390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-83f71742-8720-4793-93c6-649e3ed03bc8 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.269130 Jan 19 01:01:47.217094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 229/474] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:46 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:47.320148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:47.336435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:47.338836 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:47.340322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2def77ec-fb87-4a78-86e0-bce45ffc027d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.204149 Jan 19 01:01:47.341332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 246/475] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:47 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:47.503399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:47.503962 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:47.510554 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.511012 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.511829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.512271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.712465 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:47.721748 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c597b759-f72d-4c25-8e0f-129698104358 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.225854 Jan 19 01:01:47.722408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 230/476] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:47 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:47.955761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:47.956635 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:47.964312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.964814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:47.965730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:47.966211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.002416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0f6f93eb-b3a6-413e-a4cb-794fb2d36254 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051724 Jan 19 01:01:48.003592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 247/477] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:01:47 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:01:48.189990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1396397932", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "a5df2d14-6c77-4859-a21d-41a9de91756c"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:01:48.234999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:48.235620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:48.242718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.243165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.243969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.244399 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.403051 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:48.411715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bc7bb983-d17e-4a28-8564-60171e10afd9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.180407 Jan 19 01:01:48.412323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 248/478] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:48 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:48.416931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:48.417763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:48.430315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.430790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.431673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.432130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.594572 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:48.606781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:48.608369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:48.609652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e32ad8fe-cda5-4d06-ac4c-8c07ff1c3f48 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.196366 Jan 19 01:01:48.610274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 249/479] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:48 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:48.739239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:48.739926 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:48.748752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.749507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.750445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:48.750938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:48.903742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:48.912917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4bcb189e-520a-4e76-844d-eb8f709e4b32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.177400 Jan 19 01:01:48.913613 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 250/480] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:48 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:49.441835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:49.443003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:49.454062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.454879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:49.457047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.457946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:49.675983 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:49.689619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2f3e68c0-f61b-4d56-8d08-e53cf3273471 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.255828 Jan 19 01:01:49.691248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 251/481] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:49 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:49.703442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:49.707383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:49.718038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.718757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:49.720023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.720695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:49.890504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:49.900343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:49.901988 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:49.903213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ccadb4d2-4a77-4355-80d4-20591102e2e3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.210617 Jan 19 01:01:49.903809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 252/482] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:49 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:49.931771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:49.932390 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:49.938710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.939166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:49.940049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:49.940427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:50.131509 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:50.140178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b5af2272-c84e-4a44-911d-1aedc7fc7e1d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.211750 Jan 19 01:01:50.141012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 253/483] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:49 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:50.707789 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:50.708517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:50.715426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:50.715890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:50.717465 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:50.717958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:50.867677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:50.880549 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b392e5d7-2d49-4819-80fd-bda51a21c1f0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.175956 Jan 19 01:01:50.881659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 254/484] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:50 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:50.922982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:50.923594 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:50.930282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:50.930866 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:50.931788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:50.932333 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:51.097747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:51.113788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:51.117840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:51.122303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7c168ac3-2e91-463b-9fbb-e8c30f4d0bb7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.200688 Jan 19 01:01:51.123155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 255/485] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:50 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:51.161005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:51.161799 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:51.168916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:51.169435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:51.170426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:51.170938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:51.342317 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:51.351220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-39aded06-e86f-4b5d-a4ef-bd3478256bed tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.194422 Jan 19 01:01:51.351919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 256/486] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:51 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:51.910358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:51.911429 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:51.922045 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:51.922941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:51.925102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:51.925710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:52.114692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:52.124227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f7902328-b635-4b9e-9064-494a6113f7a3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.221200 Jan 19 01:01:52.125691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 257/487] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:51 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:52.141156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:52.141803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:52.148155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:52.148615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:52.149434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:52.149917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:52.332231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:52.343843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:52.345512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:52.347346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4531324e-feb3-4e3c-aa97-e425003d9ec2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.209933 Jan 19 01:01:52.348017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 258/488] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:52 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:52.370166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:52.370796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:52.376712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:52.377174 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:52.378225 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:52.378672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:52.570067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:52.584055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-04fa2141-f1ac-449a-8777-519a48c8377c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.217438 Jan 19 01:01:52.584708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 259/489] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:52 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:53.142547 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:53.143300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:53.149776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.150243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.151032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.151466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.307278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:53.314798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bac3ecfa-a58e-4bb3-8e69-50f16945459e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.175788 Jan 19 01:01:53.315946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 260/490] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:53 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:53.367121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:53.367787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:53.374292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.374740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.375542 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.375970 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.551064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:53.566334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:53.567933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:53.569121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-883f9681-f728-4117-a029-55e26776ccc8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.206067 Jan 19 01:01:53.569716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 261/491] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:53 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:01:53.608422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:53.609039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:53.619345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.619978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.621201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:53.621682 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:53.771893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:53.780289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-22dc85c0-5ce0-408f-a0e6-70da97979d29 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.175513 Jan 19 01:01:53.780894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 262/492] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:53 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:54.332641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:54.333583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:54.339771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.340213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.341000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.341435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.496837 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:54.504548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4d31c591-4b7e-4a46-86d6-8cae4c56d6e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.176071 Jan 19 01:01:54.505135 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 263/493] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:54 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:54.590714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:54.591717 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:54.600945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.601396 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.602220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.602657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.757285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:54.765928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:54.767490 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:54.768713 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-869874b6-459d-4cd2-8645-82fd765dd03e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.184477 Jan 19 01:01:54.769282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 264/494] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:54 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:54.805784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:54.806343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:54.813919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.814351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.815774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:54.816230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:54.978403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:54.993908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c8f26532-3b1b-4f1f-b132-c54ace4b3e2b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.191868 Jan 19 01:01:54.995598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 265/495] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:54 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:55.476923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] validate_networks() for [('a5df2d14-6c77-4859-a21d-41a9de91756c', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:01:55.531840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:55.535014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:55.555412 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:55.557351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:55.560063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:55.561770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:55.857954 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:55.875617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0ef767a0-425e-4f4b-bcc2-01e593cace9e tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.354776 Jan 19 01:01:55.877071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 266/496] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:55 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:55.887706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:55.889908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:55.909202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:55.910737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:55.912115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:55.913591 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.207249 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:56.254104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:56.257692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:56.260068 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c765f631-85bf-43f7-b38b-7015441ea58c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.379755 Jan 19 01:01:56.261148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 267/497] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:55 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:56.269740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:56.271400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:56.283752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.284547 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.285778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.286476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.418743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:01:56.419838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:01:56.421100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:01:56.421846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:01:56.423241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:01:56.441839 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.442923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.444637 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.445494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.463541 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:56.479751 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e53a8d36-dc34-40bd-bd7d-ce6a84eeba0d tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.216657 Jan 19 01:01:56.480933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 268/498] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:56 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:56.487519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:01:56.492942 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Getting quotas for user b46dddae0c2347d399239aaee9b2c486 and project 501a962e9fd5449fb8b625403e9ff8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:01:56.511892 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:01:56.516309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:01:56.581524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-392cc56d-7d69-45dd-9a8b-eb8d707c895c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.396649 Jan 19 01:01:56.582351 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 231/499] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 8398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:01:56.592558 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ba7a2600-b22a-4bb1-914e-0efcf05fbd32 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:56.594053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ba7a2600-b22a-4bb1-914e-0efcf05fbd32 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:56.652416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ba7a2600-b22a-4bb1-914e-0efcf05fbd32 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:56.664331 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ba7a2600-b22a-4bb1-914e-0efcf05fbd32 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1218 microversion: 2.1 time: 0.075358 Jan 19 01:01:56.665316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 269/500] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:56 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:56.898014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:56.898696 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:56.904925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.905366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:56.906199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:56.906867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.083794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.091207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-237121da-67f7-48b0-9726-147b6d2dc12f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.198004 Jan 19 01:01:57.091812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 232/501] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:56 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:57.280984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:57.281782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:57.288342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.288790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.289608 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.290050 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.445941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.454995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.457146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.458361 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f854fedf-10ab-41c7-acf1-a99de1992aef tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.182740 Jan 19 01:01:57.458943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 270/502] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:57 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:57.506805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:57.507480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:57.513834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.514450 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.515316 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.515811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.656862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.666366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8f1ff714-ee16-4855-803d-3c298eeaacd3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.163871 Jan 19 01:01:57.667337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 233/503] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:57 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:57.692286 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:57.692916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:57.701475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.703192 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.703192 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:57.703192 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:57.775052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:57.788208 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1728b019-e53e-48b8-84a7-aaa2e356a23f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1222 microversion: 2.1 time: 0.101004 Jan 19 01:01:57.789182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 271/504] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:57 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:58.116440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:58.117078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:58.123746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.124198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.124994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.125431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.275017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.282647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-46dc605a-5843-440e-9011-e7132f45c0d7 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.169881 Jan 19 01:01:58.283240 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 234/505] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:58 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:58.476948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:58.477481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:58.486671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.488462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.491636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.492136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.639391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.652592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.654969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.657014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-47ff294f-0022-44fd-b0ec-7ef383ba5f63 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.183662 Jan 19 01:01:58.658012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 272/506] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:58 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:58.686725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:58.687345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:58.693910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.694354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.695144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.695582 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.824319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:58.825727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:58.834003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.834694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.835617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:58.836428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:58.876024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.885112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9ec70705-d448-4386-810d-bcd6cd9455f5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.201970 Jan 19 01:01:58.889589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 235/507] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:58 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:58.934623 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:58.943108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ad3005ee-f469-446f-bca7-0e2e1311087d tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1222 microversion: 2.1 time: 0.125095 Jan 19 01:01:58.943695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 273/508] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:58 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:01:59.309574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:59.310425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:59.318409 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.319135 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.319981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.320595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.477752 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:59.490509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-57de6368-e0ae-40a0-9411-ec4394350b32 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.187347 Jan 19 01:01:59.491101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 236/509] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:59 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:01:59.684775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:59.685780 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:59.692503 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.693093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.694476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.695094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.842743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:59.852766 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:59.854634 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:01:59.855926 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d090fc54-a114-4328-993f-108e71bb2b75 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.176167 Jan 19 01:01:59.856522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 274/510] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:01:59 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:01:59.907569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:59.909532 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:59.922001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.922771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.924138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.925114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.966964 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:01:59.968089 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:01:59.994721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.995473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:01:59.996835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:01:59.997902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:00.154732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:00.167958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5e9f80a1-33b7-4fd2-9230-174c96b3235f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1222 microversion: 2.1 time: 0.206167 Jan 19 01:02:00.169347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 275/511] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:59 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:00.192491 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:00.208822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dc2089a6-97c0-4e60-868c-0d501228bdac tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.308097 Jan 19 01:02:00.210303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 237/512] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:01:59 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:00.508932 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:00.509786 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:00.520644 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:00.521181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:00.522202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:00.522638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:00.715487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:00.729986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-578be06f-0585-4372-8ded-b425b527a203 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.224825 Jan 19 01:02:00.739894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 276/513] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:00 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:00.895788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:00.897375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:00.910370 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:00.912511 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:00.914327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:00.915459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.163329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:01.173618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:01.176062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:01.177281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ac71152a-acc5-433d-80ac-e30bb7685a98 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.289294 Jan 19 01:02:01.178443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 238/514] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:00 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:01.196486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:01.197230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:01.209445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.217305 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.218533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.219079 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.227615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:01.228494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:01.238811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.239375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.240196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.240651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.396877 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:01.414797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0ac6da68-0515-4a7b-89ec-734b11e72695 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1222 microversion: 2.1 time: 0.221442 Jan 19 01:02:01.417094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 277/515] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:01 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:01.600493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:01.612504 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-198d7337-71d6-4391-833c-ccd7009a9a0a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.388319 Jan 19 01:02:01.622640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 239/516] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:01 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:01.748111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:01.748658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:01.758825 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.759372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:01.760412 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:01.760905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.063718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:02.075415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-09040159-ce98-425b-a746-c48c61133f19 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.331121 Jan 19 01:02:02.078404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 278/517] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:01 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:02.202444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:02.209008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:02.230458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.235038 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.238160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.243847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.443779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:02.446329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:02.472243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.477777 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.478938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.480966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.637796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:02.653695 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:02.670300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f826834c-a1fb-49b2-aea1-e7009538438a tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1222 microversion: 2.1 time: 0.230672 Jan 19 01:02:02.670987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 279/518] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:02 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:02.686057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:02.686057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:02.686057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.686057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.686737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:02.686737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:02.699418 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:02.703227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:02.706501 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4de26f00-415c-404e-9b15-82dbb2e8fe49 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1751 microversion: 2.20 time: 0.512028 Jan 19 01:02:02.708534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 240/519] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:02 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1751 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:03.102812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:03.104185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:03.143844 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.145233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:03.148378 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.151671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:03.295360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:03.325835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-253d229e-1640-468f-89a5-5c734b1b8f48 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.652846 Jan 19 01:02:03.328334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 280/520] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:02 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:03.717907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:03.727502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:03.773754 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.774547 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:03.779974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.780822 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:03.804705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:03.853997 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f41ab2db-3938-49ba-9e77-86861a5c3f12 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.751770 Jan 19 01:02:03.857175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 241/521] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:03 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:03.871546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:03.873077 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:03.885679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.886703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:03.888122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:03.888856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:04.020276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:04.048262 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9eba16ef-7e74-4902-bcbf-f33d1accbb62 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1214 microversion: 2.1 time: 0.345876 Jan 19 01:02:04.055665 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 281/522] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:03 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:04.212922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:04.224282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:04.226159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:04.227397 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0eae2395-0a6a-47a3-8b0e-357588bfdafb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1753 microversion: 2.20 time: 0.367163 Jan 19 01:02:04.230051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 242/523] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:03 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1753 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:04.357973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:04.361028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:04.376335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:04.378055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:04.379602 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:04.381196 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:04.647222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:04.661744 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d0bad544-05f7-4e64-a4a2-bd2b672550d1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.317362 Jan 19 01:02:04.672847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 282/524] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:04 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:04.885787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:04.887317 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:04.895247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:04.896025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:04.897132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:04.897832 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.072624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:05.075098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:05.084072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.086529 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.090551 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.094467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.210072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:05.220015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-846e9606-bc58-4231-9bec-55c2fb0fd090 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1214 microversion: 2.1 time: 0.151002 Jan 19 01:02:05.222143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 283/525] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:05 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:05.248295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:05.249366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:05.260157 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.275112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.276374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.277080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.278408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:05.304222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8b4630c9-4c4b-4e2b-bc6b-a1c56a4e1786 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.421314 Jan 19 01:02:05.321076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 243/526] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:04 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:05.514319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:05.528345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:05.531807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:05.535814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5fa3564b-4d86-4569-9fb1-2e260a6fb0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1753 microversion: 2.20 time: 0.293073 Jan 19 01:02:05.540379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 284/527] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:05 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:05.640381 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-186324265", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1638542336", "security_groups": [{"name": "tempest-secgroup-smoke-879152138"}], "networks": [{"uuid": "dd19e2c3-17df-4b1e-b564-8c6e9f2a6f03"}], "block_device_mapping_v2": [{"uuid": "bc91ae1d-c3dc-4b0b-9eba-b742948b4143", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:05.684685 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:05.685309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:05.692764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.693250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.696672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:05.697356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:05.965840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] validate_networks() for [('dd19e2c3-17df-4b1e-b564-8c6e9f2a6f03', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:02:05.982725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:06.003543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bdb0769f-b115-4779-a858-583c92b43772 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.323256 Jan 19 01:02:06.004601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 285/528] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:05 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:06.250344 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:06.258587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:06.287002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.288460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.292402 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.298345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.500696 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:06.529793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4d5bd9af-7c15-4221-907d-aff7aca30d10 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1214 microversion: 2.1 time: 0.282185 Jan 19 01:02:06.553345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 286/529] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:06 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:06.563735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:06.565210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:06.579071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.580225 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.582413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.583176 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.738982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:02:06.739732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:02:06.740466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:02:06.741102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:02:06.741940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:02:06.771428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.773104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.778978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.781820 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.835657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for project 71fc118391b34d35b75c25f76155c402. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:02:06.861209 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Getting quotas for user edbc6d028bae4706b508e2e5580506d4 and project 71fc118391b34d35b75c25f76155c402. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:02:06.911409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:06.923092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5a40552f-2a98-44c5-a212-1b100356b3c1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.367660 Jan 19 01:02:06.929667 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 287/530] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:06 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:06.931893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:06.932516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:06.952416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.952871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.953734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:06.973052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:06.984685 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:02:06.989627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc91ae1d-c3dc-4b0b-9eba-b742948b4143',volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:02:07.268278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-874bcca8-27d4-4c49-90df-85c7217b20a0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.631821 Jan 19 01:02:07.272155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 244/531] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:02:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:02:07.295848 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:07.297011 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:07.319755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:07.326027 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:07.335039 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:07.339757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:07.396399 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.413060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.415088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.416792 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0afe3126-e14f-4bee-860f-ce82795048e6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.488644 Jan 19 01:02:07.417613 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 288/532] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:06 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:07.438705 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e73835b7-b1ef-4541-9f4d-235a0e80ae88 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:07.439902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e73835b7-b1ef-4541-9f4d-235a0e80ae88 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:07.610347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e73835b7-b1ef-4541-9f4d-235a0e80ae88 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.619576 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e73835b7-b1ef-4541-9f4d-235a0e80ae88 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1088 microversion: 2.1 time: 0.184296 Jan 19 01:02:07.622635 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 289/533] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:07 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1088 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:07.622779 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.628486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:07.630042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:07.653297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:07.654265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:07.655498 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:07.656214 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:07.666220 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3d93ae7d-b562-4a8a-8516-ee00dd3709fb tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.391405 Jan 19 01:02:07.688690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 245/534] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:07 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:07.975252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:07.977380 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:07.978542 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:07.990335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e181e31b-42bf-495e-b707-e67d8daa11b3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1214 microversion: 2.1 time: 0.366098 Jan 19 01:02:07.994123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 290/535] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:07 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1214 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:08.024323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.029868 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.040983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.049043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.437763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:08.441606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:08.442502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:08.460680 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.461206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.462142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.462643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.464246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f63f4554-beaa-4ea9-9f72-418842ab92d0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.517844 Jan 19 01:02:08.468190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 246/536] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:07 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:08.641360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:08.642013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:08.655052 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.655565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.656302 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.656735 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.700636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:08.714969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:08.717017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:08.719367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-27f6e118-beaf-44f1-b8dc-fd5ce4f143e9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.282645 Jan 19 01:02:08.732960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 291/537] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:08 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:08.738764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:08.739828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:08.748034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.748905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.749967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:08.750759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:08.885598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:08.904119 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-52201766-d6c5-4a72-995e-6ef59a89205f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1138 microversion: 2.1 time: 0.268359 Jan 19 01:02:08.909090 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 247/538] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:08 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1138 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:09.012355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:09.012846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:09.029182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.041386 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.044368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.054812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.121320 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:09.170298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-34156e76-47a2-4bb7-8685-4b18ab0c420b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.425118 Jan 19 01:02:09.172045 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 292/539] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:08 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:09.332624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:09.347270 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3eb745e1-6a07-4549-9f62-43ce6c07eaff tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1214 microversion: 2.1 time: 0.338655 Jan 19 01:02:09.348512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 248/540] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:09 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:09.488517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:09.491137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:09.524153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.533534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.535957 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.538203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.741815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:09.743505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:09.764780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.766419 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.769091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:09.769869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:09.998741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.012027 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-76042f0c-a271-41b5-8e7f-629155b209a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.529344 Jan 19 01:02:10.039358 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.042008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 293/541] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:09 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:10.057717 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:10.059191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:10.065475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.071549 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.072804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.073402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.075256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.075919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e593cde4-5aac-4dc3-9c3c-d23aa95514c1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.339181 Jan 19 01:02:10.076938 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 249/542] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:09 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:10.077276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.194442 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:10.195626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:10.206572 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.227832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-55e68fa1-037b-41e9-b647-356c2e6162be tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1186 microversion: 2.1 time: 0.181822 Jan 19 01:02:10.236352 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 294/543] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:10 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1186 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:10.236886 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.237954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.239423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.241754 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.390006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:10.391342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:10.420618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.422465 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.427894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:10.432993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:10.661034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.677776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-52eb805d-76fa-403d-82c7-52ea76c7177b tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.490629 Jan 19 01:02:10.681631 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 250/544] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:10 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:10.692747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:10.703959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-815b5410-6da6-43d5-b597-5a42310e4cfa tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1270 microversion: 2.1 time: 0.338240 Jan 19 01:02:10.707170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 295/545] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:10 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1270 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:11.048072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:11.048946 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:11.059248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.059727 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.060525 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.062827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.097028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:11.097970 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:11.107088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.107551 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.108352 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.108795 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.282931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:11.306040 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:11.319303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:11.323862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8d175d62-6c1d-47c9-b040-d2ff7f3ffbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.231302 Jan 19 01:02:11.342553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 296/546] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:11 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:11.356841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:11.363331 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:11.364158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:11.373656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2e34df4e-4d61-49f6-83b0-9b8669f051d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.329564 Jan 19 01:02:11.374422 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.375102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.376059 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.376649 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.384798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 251/547] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:11 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:11.504444 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:11.513183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ede8612e-dcc4-47f5-b032-7b82e7cf6601 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1186 microversion: 2.1 time: 0.169137 Jan 19 01:02:11.514798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 297/548] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:11 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1186 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:11.708487 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:11.709504 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:11.722841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.723468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.726992 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.727682 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.735288 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:11.737453 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:11.771906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.774394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:11.780038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:11.781514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.099756 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.122166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6ed82097-c281-4f0f-af44-0c2061ac0edb tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1278 microversion: 2.1 time: 0.388726 Jan 19 01:02:12.124363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 298/549] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:11 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1278 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:12.227015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.243166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5653c8db-f87e-4200-94e2-d28a38efb029 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1566 microversion: 2.1 time: 0.538572 Jan 19 01:02:12.244396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 252/550] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:11 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1566 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:12.349184 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:12.349835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:12.356477 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.356823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.357668 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.358118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.391098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:12.392094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:12.414486 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.414945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.415748 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.416187 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.562251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.591838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.593967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.596049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d89241f5-5650-483b-82c1-ff334fb31cba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.251105 Jan 19 01:02:12.608264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 299/551] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:12 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:12.613909 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:12.631330 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:12.648552 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.649318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.654223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:12.654917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:12.795444 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.832023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-74369d2f-736f-49e7-a81d-c2d375c0ba8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1194 microversion: 2.1 time: 0.222074 Jan 19 01:02:12.839360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 300/552] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:12 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1194 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:12.866690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:12.875783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-87c858dd-b928-4db7-9fa1-46e3a9546417 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.488491 Jan 19 01:02:12.899347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 253/553] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:12 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:13.140278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:13.140961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:13.149256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.149743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.151664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.151664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.279428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:13.280276 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:13.302177 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.302623 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.311237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.315416 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.350117 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:13.360303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dfd1fdb5-1987-4f05-ad8f-9b3099a9b471 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1276 microversion: 2.1 time: 0.223381 Jan 19 01:02:13.368555 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 301/554] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:13 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:13.627627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:13.628516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:13.641267 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.641773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.651507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.651694 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.736291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:13.758346 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-15bae745-f766-4780-87b0-f95ab4c3aca0 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1546 microversion: 2.1 time: 0.500837 Jan 19 01:02:13.758987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 254/555] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:13 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1546 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:13.776938 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:13.777507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:13.783570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.784020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.785012 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.785453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:13.926815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] HTTP exception thrown: Cannot 'detach_volume' instance b1e02678-2973-4080-be5a-b589dd630ec9 while it is in vm_state rescued Jan 19 01:02:13.928301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Returning 409 to user: Cannot 'detach_volume' instance b1e02678-2973-4080-be5a-b589dd630ec9 while it is in vm_state rescued {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:02:13.930200 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d9625b65-0daf-477e-83cf-4f0f5afad5c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments/ccddbd8e-d23e-4b61-aa8a-e8dbc81bde95" status: 409 len: 152 microversion: 2.1 time: 0.157555 Jan 19 01:02:13.947817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 255/556] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:02:13 2022] DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments/ccddbd8e-d23e-4b61-aa8a-e8dbc81bde95 => generated 152 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 19 01:02:13.961211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:13.962571 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:13.981478 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:13.982690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.005833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.007656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.208607 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:14.225846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:14.231483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:14.235049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6ea119ee-9344-48ab-b8f5-cb3f4037e8ad tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.611787 Jan 19 01:02:14.238935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 302/557] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:13 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:14.259481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:14.260128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:14.272921 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:14.287527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-49e77494-e838-4aea-9352-a9476176e698 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1204 microversion: 2.1 time: 0.333156 Jan 19 01:02:14.288239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.288597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.303043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 256/558] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:13 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1204 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:14.303687 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.304439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.311678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:14.325943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:14.365091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.368632 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.375398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.376049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.853614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-03ac4a79-8a26-4380-a3e0-f65a785fc4ab tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.547146 Jan 19 01:02:14.854744 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 257/559] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:02:14 2022] POST /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:02:14.862012 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:14.864101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:14.875145 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.875983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.877429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.878212 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:14.945517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:14.968264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-091329cf-0180-4b34-8fc9-0c4ec4713e59 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.720005 Jan 19 01:02:14.969776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 303/560] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:14 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:14.976923 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:14.981504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:14.996445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:14.998653 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.002280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:15.004311 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.438386 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:15.455728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-34e357e3-d578-4b91-b116-99bb3d610d28 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.599406 Jan 19 01:02:15.464940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 258/561] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:14 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:15.484277 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:15.485108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:15.503711 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:15.504175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.513334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:15.515329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:15.515997 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.534495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a9270363-f366-43cf-84b5-5f89d0905658 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1554 microversion: 2.1 time: 0.562309 Jan 19 01:02:15.547309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 304/562] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:14 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1554 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:15.590991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:15.592152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:15.602085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:15.603136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.607137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:15.612778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:15.987486 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:15.996873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:16.003725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:16.011407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b3c6b715-84fd-45e3-b0e0-89ebec00e226 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.543853 Jan 19 01:02:16.024069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 259/563] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:15 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:16.035782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:16.040342 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:16.056205 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.056683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:16.057628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.057988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:16.410901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:16.434974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-045b22f7-d5d6-4b32-8d2c-2aea283fc8ba tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.885640 Jan 19 01:02:16.441470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 305/564] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:15 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:16.488759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:16.489802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:16.499891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.500691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:16.502263 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.503188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:16.750672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:16.759941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:16.772151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-43c6fd51-e457-4b9b-864f-1f7cba29d1bc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.292271 Jan 19 01:02:16.786952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5098d507-ab6b-4825-af3a-f1a98936b36c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.758924 Jan 19 01:02:16.787951 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 306/565] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:16 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:16.794274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:16.795273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:16.798191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 260/566] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:16 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:16.805190 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.806013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:16.807524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:16.809114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.129983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:17.131143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:17.152295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.158496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.160895 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.162852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.686151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:17.704522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4616e4bc-232f-48ef-b4fa-b3370844de7e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1554 microversion: 2.1 time: 0.915060 Jan 19 01:02:17.705162 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 307/567] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:16 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1554 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:17.722156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-332f69b6-6e9d-4da7-9395-d1209022d32d req-e4240006-bdfd-4ce5-93de-ba875ba7c0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f94565c-3ebb-44c9-affe-c5060f9e695c", "tag": "284f59e4-d32f-4e98-adc8-83e29a3730d5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:17.734194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:17.734194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:17.749100 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-332f69b6-6e9d-4da7-9395-d1209022d32d req-e4240006-bdfd-4ce5-93de-ba875ba7c0fe service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.758448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-332f69b6-6e9d-4da7-9395-d1209022d32d req-e4240006-bdfd-4ce5-93de-ba875ba7c0fe service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.790023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:17.806278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-332f69b6-6e9d-4da7-9395-d1209022d32d req-e4240006-bdfd-4ce5-93de-ba875ba7c0fe service nova] Creating event network-changed:284f59e4-d32f-4e98-adc8-83e29a3730d5 for instance 6f94565c-3ebb-44c9-affe-c5060f9e695c on hv-cinder-79987 Jan 19 01:02:17.820624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:17.832366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-332f69b6-6e9d-4da7-9395-d1209022d32d req-e4240006-bdfd-4ce5-93de-ba875ba7c0fe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121349 Jan 19 01:02:17.833465 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 308/568] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:17.836396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:17.838629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2f14cb87-d4c5-4f6a-a663-b6e233916fd4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.811468 Jan 19 01:02:17.839583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 261/569] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:17 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:17.855251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:17.863662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:17.888057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:17.893354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.894003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:17.897776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.903104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.904401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.921951 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.922126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:17.936078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:17.939894 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:18.540606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:18.549433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-526358c7-85ce-4093-a8fa-de5bab335ca2 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.710706 Jan 19 01:02:18.550335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 309/570] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:17 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:18.551092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:18.561873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-02a11990-9a7b-4439-b580-01eca2f44047 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.712946 Jan 19 01:02:18.564708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 262/571] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:17 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:18.574620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:18.575786 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:18.582683 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:18.583431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:18.591471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:18.593352 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:18.598887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11d4a42d-275e-4257-878e-b2ad1d51ac78", "device": "/dev/sdb"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:18.606589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:18.623200 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:18.623690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:18.624468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:18.624912 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:18.956428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:18.968997 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f776ec61-aec2-4fa4-b0b7-5bb55f14b337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.415511 Jan 19 01:02:18.972281 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 310/572] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:18 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:18.979220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ebbdfcd4-b1a6-430c-b6e1-7649704d29c2 req-cdde1b63-1967-4a68-8461-ab29d57c76b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:18.982432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:18.982432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:19.010436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ebbdfcd4-b1a6-430c-b6e1-7649704d29c2 req-cdde1b63-1967-4a68-8461-ab29d57c76b5 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.010880 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ebbdfcd4-b1a6-430c-b6e1-7649704d29c2 req-cdde1b63-1967-4a68-8461-ab29d57c76b5 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.057354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ebbdfcd4-b1a6-430c-b6e1-7649704d29c2 req-cdde1b63-1967-4a68-8461-ab29d57c76b5 service nova] Creating event network-changed:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:02:19.072349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ebbdfcd4-b1a6-430c-b6e1-7649704d29c2 req-cdde1b63-1967-4a68-8461-ab29d57c76b5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096756 Jan 19 01:02:19.073231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 311/573] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:19.085044 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:19.088387 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:19.108090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.108583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.109518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.109987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.197935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8ee890ee-8a95-423a-a04f-c7f6b0cdff84 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "POST /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629004 Jan 19 01:02:19.207132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 263/574] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:02:18 2022] POST /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:19.215385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:19.216349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:19.224162 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.225001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.226859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.227995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.625219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:19.649543 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:19.658643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:19.666019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-975dcedf-3e82-401d-8184-0fa80c17ea9b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.455731 Jan 19 01:02:19.666800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 264/575] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:19 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:19.676616 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:19.679845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:19.686458 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.687376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.688392 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.690376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.798053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:19.872347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ee545fe9-9220-4114-86bc-7bd219432ede tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1554 microversion: 2.1 time: 0.797074 Jan 19 01:02:19.885864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 312/576] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:19 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1554 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:19.912571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:19.913355 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:19.936673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.937276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:19.938458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:19.946652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.007353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:20.016564 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6aab1369-1260-4c87-a5ca-3ddc2f6ba775 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.347201 Jan 19 01:02:20.016564 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 265/577] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:19 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:20.029632 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:20.030556 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:20.037545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.038377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.039435 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.040105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.469897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:20.492168 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-59299c92-f435-4df6-b0ba-c0f2238bd9cc tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.474903 Jan 19 01:02:20.492972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 266/578] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:20 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:20.557502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:20.567227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c1c004b2-3097-4774-93ef-481fdfd65f97 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.680190 Jan 19 01:02:20.581664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 313/579] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:19 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:20.693239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:20.694464 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:20.709939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.711366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.714412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.718319 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.896771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:20.914077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:20.920679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.921136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:20.921959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:20.922433 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.085739 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.116199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.123932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.128722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-13b5a00a-3f57-438a-801f-914127bfb831 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.446902 Jan 19 01:02:21.131901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 267/580] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:20 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:21.144406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:21.160831 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:21.199937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.199937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.201148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.201626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.337522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.392611 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-720fc153-ed6a-4528-9873-60a2683fee32 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1554 microversion: 2.1 time: 0.492272 Jan 19 01:02:21.395451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 314/581] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:20 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1554 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:21.410205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-05b6c9cd-e246-4c3a-a539-bedfe44abd97 req-409d2559-2f41-4be5-9783-8acd6b3d1c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "name": "network-vif-plugged", "status": "completed", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:21.412322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:21.412322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:21.420768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-05b6c9cd-e246-4c3a-a539-bedfe44abd97 req-409d2559-2f41-4be5-9783-8acd6b3d1c18 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.421217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-05b6c9cd-e246-4c3a-a539-bedfe44abd97 req-409d2559-2f41-4be5-9783-8acd6b3d1c18 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.437287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-05b6c9cd-e246-4c3a-a539-bedfe44abd97 req-409d2559-2f41-4be5-9783-8acd6b3d1c18 service nova] Creating event network-vif-plugged:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:02:21.480146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-05b6c9cd-e246-4c3a-a539-bedfe44abd97 req-409d2559-2f41-4be5-9783-8acd6b3d1c18 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081130 Jan 19 01:02:21.488596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 315/582] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:21.508811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:21.509517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:21.524902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.525358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.536135 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.538659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.571178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.583948 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7ad6ae59-3809-4357-877f-763ce36e0a98 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.450094 Jan 19 01:02:21.584954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 268/583] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:21 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:21.593678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:21.594304 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:21.613102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.616527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.617440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:21.617919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:21.954256 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:21.968993 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b4caf4e3-90b5-4722-90b1-ecc5d5e1fb26 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.382596 Jan 19 01:02:21.979331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 269/584] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:21 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:22.150089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:22.150089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:22.178123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.178123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.178123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.178123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.242771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.257812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4e592d37-6a9d-4d21-9664-7bc560fb7f70 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.752302 Jan 19 01:02:22.262619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 316/585] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:21 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:22.420356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:22.421441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:22.438598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.440353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.442146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.445479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.454044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.464335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.465891 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.468221 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-876e189c-5bb5-49b0-b8af-9ce7a39c0bf8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.323171 Jan 19 01:02:22.469730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 270/586] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:22 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:22.601472 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:22.603422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:22.634395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.636305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.639383 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.640231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.689345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.699087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f6283b51-c138-4ce6-b152-a9f63a2a9286 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1560 microversion: 2.1 time: 0.282480 Jan 19 01:02:22.700631 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 317/587] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:22 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1560 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:22.823776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:22.825004 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:22.836419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.837449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.838718 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:22.839691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:22.990510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:22.999732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-87ebb906-45e8-4425-998b-2e7c5d6f4714 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.402790 Jan 19 01:02:23.000327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 271/588] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:22 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:23.004706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:23.005237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:23.022618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.022798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'services' on Instance uuid b1e02678-2973-4080-be5a-b589dd630ec9 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:02:23.023060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.023905 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.024298 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.153096 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ff39ca72-aa60-46f8-9587-25f5f82b9f4a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments/ccddbd8e-d23e-4b61-aa8a-e8dbc81bde95" status: 202 len: 0 microversion: 2.1 time: 0.334694 Jan 19 01:02:23.157292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 318/589] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:02:22 2022] DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments/ccddbd8e-d23e-4b61-aa8a-e8dbc81bde95 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:02:23.173355 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:23.174484 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:23.191785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.192188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.192999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.193436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.286690 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6a6983b7-b2d3-4010-8cd8-6f1ba02c176f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124306 Jan 19 01:02:23.287418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 319/590] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:23 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:23.306752 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:23.307374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:23.329066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.330784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.334049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.335650 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:23.338366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.347642 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f7c73f5b-1c1b-4485-9ec1-edcf576605d7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.345536 Jan 19 01:02:23.348814 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 272/591] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:23 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:23.499251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:23.499890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:23.507870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.510370 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.511215 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:23.511855 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:23.624178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:23.631965 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d92a2c2e-9dc9-4db9-a7be-4b18ba1bb96a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.339123 Jan 19 01:02:23.632564 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 320/592] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:23 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:23.844841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:23.876232 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:23.881978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:23.884768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fe83406a-3422-4b73-ab37-6746141bec31 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.389088 Jan 19 01:02:23.886459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 273/593] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:23 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:24.020083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.021763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.051245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.052564 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.057125 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.058628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.300875 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.302255 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.311103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.312405 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.314900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.315661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.355978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-02e50f69-07f1-4fb3-8dce-a33371efdb60 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060721 Jan 19 01:02:24.357297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 274/594] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:24 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:24.373980 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.374940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.376231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:24.382478 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.383184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.384583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.385176 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.395047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0cc133cc-7812-4703-9786-9efd168344a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.377389 Jan 19 01:02:24.405235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 321/595] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:24 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:24.567978 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:24.575665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-932592d2-8a79-4128-af31-b83eb7578bba tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.205518 Jan 19 01:02:24.585681 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 275/596] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:24 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:24.649159 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.650093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.679038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.680538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.695074 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.695823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.860515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:24.860937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.861466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.884143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.884519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.885544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.886184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.891134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3b5b9198-d7a2-44eb-b41e-36017ed84337 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.245408 Jan 19 01:02:24.894830 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 322/597] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:24 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:24.914452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:24.918874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:24.926336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.926939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:24.927896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:24.929476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.030841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lazy-loading 'services' on Instance uuid d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:02:25.153940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c64dcb36-b16f-4889-a7b7-3ea756fbc5ae tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments/3bc5d4f9-ea9a-44e0-bd24-a6fb59f35d6b" status: 202 len: 0 microversion: 2.1 time: 0.296936 Jan 19 01:02:25.159267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 276/598] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:02:24 2022] DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments/3bc5d4f9-ea9a-44e0-bd24-a6fb59f35d6b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:02:25.185073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:25.196403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:25.198264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:25.199580 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-40931232-ef12-48b6-9105-6a4ff077e07d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.294181 Jan 19 01:02:25.200652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 323/599] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:24 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:25.370434 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:25.371438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:25.385611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.386629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.387645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.388703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.413649 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:25.418419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:25.432757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-087d95cd-be31-440c-848f-a95266af71b5 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067545 Jan 19 01:02:25.433151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.433927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.437462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.437665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 277/600] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:25 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:25.437777 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.592640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:25.593219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:25.602123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.602680 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.604508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.615734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.658367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:25.666716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1d7834b4-2820-43f2-85dd-1e8d8bb2a656 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.258383 Jan 19 01:02:25.667392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 324/601] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:25 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:25.764836 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:25.772618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-20e5a91c-983b-4507-855d-8e208895d554 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.184369 Jan 19 01:02:25.773185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 278/602] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:25 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:25.913136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:25.913692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:25.919656 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.920219 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:25.920919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:25.921325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.056088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.064107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f553b8d1-fb36-41db-bffd-7083bf70ea9f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.154830 Jan 19 01:02:26.073329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 325/603] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:25 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:26.217590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:26.218379 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:26.229811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.230670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.231730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.232275 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.382901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.391633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.393783 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.394973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-61655692-db52-4735-84b8-666a948f33f5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.181299 Jan 19 01:02:26.395531 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 279/604] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:26 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:26.444634 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:26.445856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:26.452447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.453349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.454182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.455629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.487007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-95483805-78d7-499d-8316-a9ca29193b46 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Jan 19 01:02:26.487589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 326/605] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:26 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:26.687463 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:26.688291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:26.697904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.698565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.699771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.700730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.795537 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:26.798100 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:26.808679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.809470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.810512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:26.811063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:26.978390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.992336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:26.993748 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-72caead3-c05d-47c6-b52e-ee8cac87c6aa tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.311496 Jan 19 01:02:26.995043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 280/606] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:26 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:27.002103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4dff4a99-e7c8-44da-836c-522d36d95491 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.213887 Jan 19 01:02:27.002987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 327/607] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:26 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:27.082932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:27.083774 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:27.093466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.094151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.095548 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.096337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.279913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:27.288318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ac069428-89f9-4eca-a9fb-dad1973679b3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.211412 Jan 19 01:02:27.290097 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 281/608] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:27 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:27.418103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:27.419253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:27.432130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.433106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.435438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.436227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.501657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:27.503460 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:27.515300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.516485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.518193 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:27.519305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:27.605697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8bbac8b4-a4ff-4554-83f0-b4f7008e6bf7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110434 Jan 19 01:02:27.607318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 282/609] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:27 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:27.690165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:27.706558 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:27.708250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:27.709475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fb22a7a7-6d07-4ac5-bd14-ba8b9f47d7f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.298654 Jan 19 01:02:27.710340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 328/610] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:27 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:28.032405 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:28.035335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:28.039393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:28.040594 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:28.042651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.043241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.044509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.044719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.048707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.050843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.052891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.053673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.209596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.220115 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-35e7880d-3263-4e08-9823-e78b87988dca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.201458 Jan 19 01:02:28.220723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 283/611] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:28 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:28.232031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.240340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e742f78f-7bfb-4b6d-8606-6fde64d4f810 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.221308 Jan 19 01:02:28.241373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 329/612] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:28 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:28.305839 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:28.306456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:28.312819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.313271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.314653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.315094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.503332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.511268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-73bde4b9-0022-4856-8eef-491e64721f1f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.209317 Jan 19 01:02:28.511863 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 284/613] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:28 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:28.621827 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:28.622787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:28.629977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.630437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.631419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.631864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.663067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f8e8709f-712b-45a7-96c2-00f8ce1bd3f1 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Jan 19 01:02:28.663658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 330/614] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:28 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:28.731976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:28.733163 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:28.740248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.740703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.741494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:28.741975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:28.945129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.953689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.955177 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:28.956327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-38061292-61cf-4b88-8ba3-c351b7ef6936 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.231488 Jan 19 01:02:28.956890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 285/615] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:28 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:29.243607 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:29.244330 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:29.250458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.250996 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.251883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.252417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.258234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:29.259070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:29.266157 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.266646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.268318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.268962 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.433143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:29.438912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:29.442202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3700fcd2-ad88-4510-ba54-cc96ca31e076 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.187593 Jan 19 01:02:29.447491 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-60e58333-c0e0-41c4-998d-148021d9f074 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.212356 Jan 19 01:02:29.455250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 331/616] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:29 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:29.455541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 286/617] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:29 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:29.529393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:29.530094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:29.538075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.538840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.539857 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.540302 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.676770 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:29.678258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:29.691508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.691967 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.697123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.697123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.766499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-04e9167a-6845-441e-8456-bf1c2c5ae415 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094215 Jan 19 01:02:29.767941 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 287/618] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:29 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:29.786163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:29.795418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fd9905a8-35d7-4ca4-bb30-e3f08197b4ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.270577 Jan 19 01:02:29.805309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 332/619] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:29 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:29.975224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:29.975792 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:29.982703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.983165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:29.983992 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:29.985071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.150490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.159809 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.161315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.162492 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a32a20e5-30a3-4dc2-b2af-8f16901ba004 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.191156 Jan 19 01:02:30.163412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 288/620] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:29 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:30.460750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:30.461541 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:30.465707 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:30.466423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:30.467774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.468310 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.469194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.469741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.474423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.474882 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.476466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.477100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.639254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.652586 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e87cc756-0cdd-4c2c-ab91-3c43aeb4312b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.195193 Jan 19 01:02:30.653251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 333/621] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:30 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:30.664281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.672305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-70ef5565-7a86-4851-bdec-16504df41301 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.211124 Jan 19 01:02:30.672901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 289/622] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:30 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:30.779760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:30.780784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:30.787007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.787525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.788259 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.788691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.812920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:30.813588 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:30.821901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1388aef5-a4f2-477e-bd44-f3009f7454d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Jan 19 01:02:30.822496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 334/623] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:30 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:30.822749 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.823309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.824252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:30.824986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:30.969676 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:30.977454 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-de6558a0-c302-4f0b-af80-f7b13371984d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.168927 Jan 19 01:02:30.978081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 290/624] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:30 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:31.181055 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:31.181730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:31.188299 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.188845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.189679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.190122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.352702 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:31.362648 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:31.364270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:31.365625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3fbfc3a3-9eea-466e-be0d-156ee9da2122 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.188165 Jan 19 01:02:31.366298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 335/625] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:31 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:31.671290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:31.671908 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:31.678292 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.678745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.679536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.679972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.693677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:31.695283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:31.701298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.701788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.702585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.703023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.819735 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:31.827832 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6427da65-1160-47e9-9aa6-ea7acddb2225 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.160027 Jan 19 01:02:31.828608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 291/626] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:31 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:31.837708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:31.838743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:31.845231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.845737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.846548 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:31.846986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:31.869813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:31.879415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-be7db1c4-8940-41f6-b4f9-c4bf4b87408a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.189193 Jan 19 01:02:31.879683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d8e47cde-ce84-4fa5-a7dd-c7c6e96188c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Jan 19 01:02:31.882979 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 336/627] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:31 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:31.883693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 292/628] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:31 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:31.994980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:31.995583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:32.001966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.002416 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.003181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.003615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.151140 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:32.158774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0c674db0-dc8d-48a8-ae5c-67d5bd5439e3 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.167317 Jan 19 01:02:32.159367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 337/629] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:31 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:32.384213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:32.384829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:32.391009 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.391459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.392248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.392684 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.527975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:32.537620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:32.539118 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:32.540286 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-67cea401-8829-4c27-9c8c-9a2420f1c0ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.159817 Jan 19 01:02:32.540848 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 293/630] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:32 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:32.845661 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:32.846282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:32.853020 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.853480 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.854296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.854740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.892903 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:32.893914 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:32.902011 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.902728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.903547 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.903996 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.939914 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-de20a3a2-4127-44b9-a437-68e54d6f548c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052551 Jan 19 01:02:32.944239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 294/631] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:32 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:32.944926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:32.945544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:32.951649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.952110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.952913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:32.953358 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:32.989665 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:32.998169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4b652233-6681-4c06-8e4e-962f8e5d48c7 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.156224 Jan 19 01:02:33.000145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 338/632] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:32 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:33.100131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:33.107553 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-90a7019c-2de4-4fcc-b1c1-47165e930c74 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.165951 Jan 19 01:02:33.108151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 295/633] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:32 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:33.171218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-db3b5865-3630-4d8c-ab41-08c432be6f39 req-f2f03ac7-80a0-4bd5-a20b-378ea8ca34ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f94565c-3ebb-44c9-affe-c5060f9e695c", "name": "network-vif-plugged", "status": "completed", "tag": "284f59e4-d32f-4e98-adc8-83e29a3730d5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:33.173006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:33.173006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:33.177604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:33.178284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:33.182083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-db3b5865-3630-4d8c-ab41-08c432be6f39 req-f2f03ac7-80a0-4bd5-a20b-378ea8ca34ec service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.182534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-db3b5865-3630-4d8c-ab41-08c432be6f39 req-f2f03ac7-80a0-4bd5-a20b-378ea8ca34ec service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.184604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.185069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.187207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.187207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.194393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-db3b5865-3630-4d8c-ab41-08c432be6f39 req-f2f03ac7-80a0-4bd5-a20b-378ea8ca34ec service nova] Creating event network-vif-plugged:284f59e4-d32f-4e98-adc8-83e29a3730d5 for instance 6f94565c-3ebb-44c9-affe-c5060f9e695c on hv-cinder-79987 Jan 19 01:02:33.199669 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-db3b5865-3630-4d8c-ab41-08c432be6f39 req-f2f03ac7-80a0-4bd5-a20b-378ea8ca34ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Jan 19 01:02:33.200579 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 339/634] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:33.324210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:33.332837 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bbb1bf7b-8752-4ec7-bce0-e3eaa1db8964 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1357 microversion: 2.1 time: 0.160235 Jan 19 01:02:33.333431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 296/635] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:33 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:33.563144 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:33.566683 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:33.574748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.575421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.576426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.577033 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.759233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:33.768411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:33.770137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:33.771176 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9a4e7e13-4124-48bc-8695-edadec454d02 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.214248 Jan 19 01:02:33.771740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 340/636] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:33 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:33.951807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:33.952842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:33.961394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.961394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.961394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:33.962902 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:33.999546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-296527df-0a72-4ecc-8e7f-4583a00075db tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051017 Jan 19 01:02:34.004134 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 297/637] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:33 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:34.014354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.015314 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.023100 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.023655 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.024829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.025760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.123852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.124516 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.130330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.130808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.131581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.132019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.165181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:34.176673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-362a3923-7859-4b86-a20b-f7dbc219f382 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.165781 Jan 19 01:02:34.177173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 341/638] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:34.274910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:34.285451 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-04443a33-ce58-4fd2-9cf1-b5acc1b776b6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.165091 Jan 19 01:02:34.286096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 298/639] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:34.350901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.351543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.357969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.358510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.359309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.359757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.498548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:34.505769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-be80cd6d-00bc-4afa-ab82-c3ae3319d3ac tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1548 microversion: 2.1 time: 0.158699 Jan 19 01:02:34.506345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 342/640] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:34.525310 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.526313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.536795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.537527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.538860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.539588 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.678764 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:34.686293 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-369f2fef-a736-442b-ae99-0c130d905293 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1548 microversion: 2.1 time: 0.166731 Jan 19 01:02:34.686918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 299/641] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:34.701860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.705931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:34.705931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:34.706976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:34.707735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Searching by: {'deleted': False, 'project_id': '57a740c1bb3e424287752ebd823d57ec'} {{(pid=116545) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 19 01:02:34.714689 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.715145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.715958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.716401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.790414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.791303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.798367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.798916 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.800066 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.800586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.825533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.multi_cell_list [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 19 01:02:34.946488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bd126735-9601-4fe6-8735-355534499b8f tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.248159 Jan 19 01:02:34.947308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 343/642] 10.222.0.35 () {58 vars in 1124 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:34.957787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:34.958418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:34.964483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.964966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:34.965800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:34.966248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.055913 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.077860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.083675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.086447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1b6f1c79-0fc2-4d17-abba-430daf0c19ba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.299324 Jan 19 01:02:35.088206 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 300/643] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:35.097828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:35.100372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:35.126997 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.127599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.129879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.130569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.166759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-665dec5c-fa7a-46bf-af8a-9440dcbad315 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076710 Jan 19 01:02:35.174460 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 301/644] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:35 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:02:35.175553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.182973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2a58edd1-dbc8-49d3-bd1c-cb7bbbdf8934 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1548 microversion: 2.1 time: 0.229374 Jan 19 01:02:35.184022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 344/645] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:34 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:35.199246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:35.200030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:35.207345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.208482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.209743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.210715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.302764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:35.303452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:35.310228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.311016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.312122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:35.312729 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:35.543318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.568117 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3e82859e-bf3b-4e30-b226-9c019e566452 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.269519 Jan 19 01:02:35.573760 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:35.586775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 345/646] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:35 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:35.593714 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-30d360a0-9fc8-4429-9128-50876d40f2e9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.401088 Jan 19 01:02:35.594403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 302/647] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:35 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:36.115057 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:36.115775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:36.123017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.123566 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.124450 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.124961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.283448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:36.304279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:36.307804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:36.310377 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9d46b026-f6a9-4f54-b05f-ea4e90b7356e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.198493 Jan 19 01:02:36.311568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 346/648] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:36 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:36.597898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:36.598653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:36.605091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.605536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.606361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.606789 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.613006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:36.613776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:36.620291 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.620745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.621684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:36.622888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:36.756739 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:36.766946 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-009756b5-66e0-4ae6-aff1-70d640c8b5a6 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.172251 Jan 19 01:02:36.767818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 303/649] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:36 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:36.783206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:36.791258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-19e49d93-d20a-48f0-a9d0-be5aaca99ca5 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.182699 Jan 19 01:02:36.791862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 347/650] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:36 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:37.331193 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:37.331808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:37.337937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.338389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.339185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.339630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.482571 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:37.493047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:37.493909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:37.495288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c040f7c0-e43c-43b7-82ef-58880c9009fb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.167845 Jan 19 01:02:37.495878 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 304/651] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:37 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:37.785383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:37.786104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:37.792733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.793191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.794038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.794479 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.808669 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:37.809280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:37.816877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.817338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.818179 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:37.818620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:37.963282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:37.972395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7869c051-9b13-4b32-9e54-b5cc067c5d6e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.167639 Jan 19 01:02:37.972866 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 305/652] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:37 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:37.988277 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:37.999167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4ecdcf05-3def-4dd1-8345-ef765e6d5a8e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.217052 Jan 19 01:02:37.999888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 348/653] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:37 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:38.514999 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:38.515630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:38.522191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:38.522553 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:38.523362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:38.523806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:38.681133 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:38.690558 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:38.692083 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:38.693949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-12ddf42c-f528-4d5a-b28e-c48cd358e4f0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.182850 Jan 19 01:02:38.694641 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 306/654] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:38 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:38.991383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:38.992147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:39.000887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.001613 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.003531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.004234 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.020318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:39.021180 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:39.029355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.029829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.030635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.031070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.317641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.325600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6db94f01-7fee-472b-8340-ec22746c4b5f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1318 microversion: 2.1 time: 0.338150 Jan 19 01:02:39.326118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 349/655] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:38 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:39.339772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8764012d-23f0-43ea-ae9d-56c6af74cdca"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:39.341040 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:39.347708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.348158 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.348959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.349395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.491710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.499521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-54eaeb5b-7958-42de-80dd-4dc2b6b7569b tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.483531 Jan 19 01:02:39.500274 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 307/656] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:39 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:39.505129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-70ee4be2-1af7-482e-b04a-fc73bdea18c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:39.511639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ee4be2-1af7-482e-b04a-fc73bdea18c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.512094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70ee4be2-1af7-482e-b04a-fc73bdea18c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.538319 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-70ee4be2-1af7-482e-b04a-fc73bdea18c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Going to try to stop instance {{(pid=116543) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 01:02:39.604323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-70ee4be2-1af7-482e-b04a-fc73bdea18c1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 202 len: 0 microversion: 2.1 time: 0.102136 Jan 19 01:02:39.605432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 308/657] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:02:39 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:02:39.618775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:39.620685 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:39.635271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.636168 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.637738 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.638604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.738476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-655fe65d-00e6-4c55-9400-6624fa5045d9 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402140 Jan 19 01:02:39.758315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 350/658] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:02:39 2022] POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:39.783204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:39.784833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:39.797498 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.798971 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.800253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:39.800775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:39.844374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.852397 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-78004b4e-cd53-4a06-95f1-31c3c3440a61 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.240868 Jan 19 01:02:39.853098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 309/659] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:39 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:39.950949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.960060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.961793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:39.962961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-887f8721-0f83-40e2-b437-493ceeeea6da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.202726 Jan 19 01:02:39.963621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 351/660] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:39 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:40.343265 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:40.344068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:40.352896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.353725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.354829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.355285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.524874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:40.525778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:40.529372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:40.532768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.533243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.534133 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.534575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.544047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b053443d-abad-407e-afb0-d3098adbc05f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1508 microversion: 2.1 time: 0.204099 Jan 19 01:02:40.545145 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 310/661] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:40 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:40.701121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:40.710354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e585487e-9640-418c-b3cc-fc533c297b1d tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.190396 Jan 19 01:02:40.711077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 352/662] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:40 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:40.871401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:40.872197 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:40.881979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.882671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.883630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.884160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.921088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:40.923151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:40.942424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.943129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:40.945166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:40.946803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.023122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:02:41.085429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.097986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a3b6e65e-f4fc-4906-b1aa-19058b4e1d21 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.230139 Jan 19 01:02:41.099002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 311/663] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:40 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:41.107221 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:41.108355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:41.116647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-96811d74-15e2-4c5b-81b0-e679b4c33a96 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 204 len: 0 microversion: 2.1 time: 0.216302 Jan 19 01:02:41.117383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 353/664] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:02:40 2022] DELETE /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 01:02:41.120771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.120771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.120771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.121078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.127420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:41.128437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:41.134617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.135076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.135882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.136332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.277010 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.292847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.293038 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.294395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.295587 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-06248b7f-119e-430d-b897-69eeb612f0c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.195211 Jan 19 01:02:41.297615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 312/665] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:41 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:41.306588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-15f405f8-152c-4ff8-be82-30ea8e367725 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1507 microversion: 2.1 time: 0.183795 Jan 19 01:02:41.307770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 354/666] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:41 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:41.728769 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:41.729505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:41.738228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.738890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.740171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:41.741258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:41.902190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:41.909867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-25f6cfb6-f6f7-4125-bba0-cad9a4fd25ea tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.185132 Jan 19 01:02:41.910470 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 313/667] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:41 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:42.071726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a736a9e-0a87-49a3-813f-9a7b786751b4"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:42.072870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.079221 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.079673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.080460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.080902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.116103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:42.116921 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.122983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.123520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.124394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.124926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.266034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:42.275522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f70c9a3a-8c30-4422-b1dc-b4d29fe27681 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.163281 Jan 19 01:02:42.276341 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 314/668] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:42 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:42.314062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:42.315071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.321018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.321715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.322828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.323462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.391284 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d17da4fb-8b71-4b92-a888-c59659918761 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "POST /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323109 Jan 19 01:02:42.392507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 355/669] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:02:42 2022] POST /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:42.399156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:42.399865 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.406681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.407175 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.408198 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.408633 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.494761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:42.511522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:42.513152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:42.514290 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bc9a2a6b-0538-48cb-aa3e-fce7ee207a13 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.204324 Jan 19 01:02:42.518608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 315/670] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:42 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:42.561784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:42.568024 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:42.568702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.570922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7e015e0c-3931-4b81-96ee-7abebab31401 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1507 microversion: 2.1 time: 0.177172 Jan 19 01:02:42.571522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 356/671] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:42 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:42.583894 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.584423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.585314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.585860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.669971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lazy-loading 'services' on Instance uuid aca39699-5b1c-41e3-8fbe-4b914265d69f {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:02:42.741919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cdabe502-b11b-4ecf-9597-7deddf249ae1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f/os-volume_attachments/11d4a42d-275e-4257-878e-b2ad1d51ac78" status: 202 len: 0 microversion: 2.1 time: 0.177953 Jan 19 01:02:42.747557 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 316/672] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:02:42 2022] DELETE /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f/os-volume_attachments/11d4a42d-275e-4257-878e-b2ad1d51ac78 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:02:42.928365 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:42.928974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:42.935371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.935812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:42.936598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:42.937031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.084397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.092526 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4b8ec408-c7eb-457b-9d8d-dfa1af76cec4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.167969 Jan 19 01:02:43.093114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 357/673] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:42 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:43.293366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:43.294090 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:43.301132 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.301606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.302397 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.302834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.440145 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.448534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-49e8de21-54aa-47dd-a530-529beb6dd879 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.159786 Jan 19 01:02:43.449114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 317/674] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:43 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:43.536183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:43.536806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:43.543514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.543879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.544674 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.545112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.588091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:43.588918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:43.595813 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.596282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.597759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:43.598209 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:43.697071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.710289 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.712550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.714257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-eaaa22dc-99f3-44ca-9a5d-f718c37f0f3c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.182006 Jan 19 01:02:43.715009 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 358/675] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:43 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:43.749543 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:43.757904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-808b7bc6-91fe-4e85-8876-80993934af4c tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1507 microversion: 2.1 time: 0.173442 Jan 19 01:02:43.758505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 318/676] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:43 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:44.110799 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:44.111614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:44.118026 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.118486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.119461 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.119912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.269340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.277746 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0b32fede-7f77-4fb0-80cc-62e5d6c81df9 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.170913 Jan 19 01:02:44.278670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 359/677] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:44 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:44.467121 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:44.467869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:44.474845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.475632 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.477043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.477867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.620357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.627750 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-786bc6fb-b9b7-4faa-8c09-cc74358892df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.164494 Jan 19 01:02:44.628335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 319/678] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:44 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:44.735169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:44.736332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:44.742981 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.743485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.744294 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.744735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.776671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:44.777846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:44.789977 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.790927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.792464 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:44.793355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:44.905113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.925158 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.928864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.931528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9b53660a-7874-421a-860e-7b7a1a5e453b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.199924 Jan 19 01:02:44.932906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 360/679] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:44 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:44.962929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:44.972250 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3a6fc814-f49a-467a-9102-45665c620a7a tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1507 microversion: 2.1 time: 0.199746 Jan 19 01:02:44.973007 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 320/680] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:44 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:45.298213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:45.299076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:45.306991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.307593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.309096 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.309592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.582563 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:45.595728 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0ab92637-2ed6-4902-a134-95ba5d033db0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.303066 Jan 19 01:02:45.597090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 361/681] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:45 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:45.664483 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:45.666171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:45.677983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.678909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.680495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.681403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.881972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:45.887532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-18db36f7-a627-4501-8e11-7de820f3c02b req-60f9c7b4-f8b6-46e5-9abd-86b7b268dbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "name": "network-vif-plugged", "status": "completed", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:45.890531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:45.890531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:45.891529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-56aace19-f9ec-4390-89cf-f61d0ea744e9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.235588 Jan 19 01:02:45.892460 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 321/682] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:45 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:45.904195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-18db36f7-a627-4501-8e11-7de820f3c02b req-60f9c7b4-f8b6-46e5-9abd-86b7b268dbc0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.905360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-18db36f7-a627-4501-8e11-7de820f3c02b req-60f9c7b4-f8b6-46e5-9abd-86b7b268dbc0 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.928924 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-18db36f7-a627-4501-8e11-7de820f3c02b req-60f9c7b4-f8b6-46e5-9abd-86b7b268dbc0 service nova] Creating event network-vif-plugged:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:02:45.939475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-18db36f7-a627-4501-8e11-7de820f3c02b req-60f9c7b4-f8b6-46e5-9abd-86b7b268dbc0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055311 Jan 19 01:02:45.941033 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 362/683] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:45.960735 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:45.961887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:45.969540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.970026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:45.971185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:45.971729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.020700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:46.022063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:46.058340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.059771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.079657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.080475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.178467 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:46.192763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:46.196035 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:46.197670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-979a0678-a1e5-4f33-a87b-93e423ec702b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.241091 Jan 19 01:02:46.214399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 322/684] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:45 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:46.291363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:46.300906 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-815fc748-3caa-4608-a15a-959fb2f1fdcd req-cec5d94d-91f9-44fb-ad31-89738e644d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c1f091-fd00-4336-ac27-00b75a950e01", "name": "network-vif-deleted", "tag": "32c13ac8-bf95-47c1-9b8f-b346eaddc840"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:46.309986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:46.309986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:02:46.322738 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9e3c9c9d-b712-40f2-87ea-b13d4d6370c6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1465 microversion: 2.1 time: 0.322713 Jan 19 01:02:46.338658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 363/685] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:45 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1465 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:46.344137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-815fc748-3caa-4608-a15a-959fb2f1fdcd req-cec5d94d-91f9-44fb-ad31-89738e644d4a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.345881 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-815fc748-3caa-4608-a15a-959fb2f1fdcd req-cec5d94d-91f9-44fb-ad31-89738e644d4a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.375377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-815fc748-3caa-4608-a15a-959fb2f1fdcd req-cec5d94d-91f9-44fb-ad31-89738e644d4a service nova] Creating event network-vif-deleted:32c13ac8-bf95-47c1-9b8f-b346eaddc840 for instance a2c1f091-fd00-4336-ac27-00b75a950e01 on hv-cinder-79987 Jan 19 01:02:46.382101 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-815fc748-3caa-4608-a15a-959fb2f1fdcd req-cec5d94d-91f9-44fb-ad31-89738e644d4a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104970 Jan 19 01:02:46.383424 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 323/686] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:46.617215 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:46.617862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:46.623911 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.624372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.625167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.625639 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.761129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:46.769105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5dffcdd1-858c-4b81-915b-449973adac84 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.155813 Jan 19 01:02:46.769712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 364/687] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:46 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:46.909224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:46.909862 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:46.916074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.916530 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:46.917324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:46.917794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.064822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.072677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-15167fc0-c24f-4c7b-a8c3-793a122ac4db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.168017 Jan 19 01:02:47.073259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 324/688] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:46 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:47.226494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:47.227024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:47.233586 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.234062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.234896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.235888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.345971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:47.346583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:47.357190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.357190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.357190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.357190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.378444 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.387103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.388610 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.389796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-633da121-279b-4a62-a0b5-6f00cbbc3f07 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.167087 Jan 19 01:02:47.390368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 365/689] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:47 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:47.391965 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.392496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.392955 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'fault' on Instance uuid a2c1f091-fd00-4336-ac27-00b75a950e01 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:02:47.435199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.443116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-37346270-8686-4f39-b85f-a9ce05b0f748 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 200 len: 1312 microversion: 2.1 time: 0.100841 Jan 19 01:02:47.443690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 325/690] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:47 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:47.786315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:47.786933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:47.792905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.793368 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.794205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:47.794651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:47.932635 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:47.940377 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-69c3314e-53e8-4b41-8ff7-74ca02e46280 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1259 microversion: 2.1 time: 0.158237 Jan 19 01:02:47.940959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 366/691] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:47 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:48.090201 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.090815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.097763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.098215 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.099009 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.099442 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.258979 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.267531 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a650ec31-9ad9-4397-be4e-bd02d4f6c15f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.180907 Jan 19 01:02:48.268142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 326/692] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:48.416582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.417435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.427013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.428391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.429243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.429335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.474293 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.474293 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: a2c1f091-fd00-4336-ac27-00b75a950e01] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.480017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.483277 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.484190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.484642 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.508079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] HTTP exception thrown: Instance a2c1f091-fd00-4336-ac27-00b75a950e01 could not be found. Jan 19 01:02:48.509846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Returning 404 to user: Instance a2c1f091-fd00-4336-ac27-00b75a950e01 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:02:48.511327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8e0e8347-6038-488a-aeea-6aed4abd383e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01" status: 404 len: 111 microversion: 2.1 time: 0.053003 Jan 19 01:02:48.514326 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 327/693] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/a2c1f091-fd00-4336-ac27-00b75a950e01 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:02:48.523595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.525297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.534120 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.535119 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.536217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.537030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.573258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:02:48.602691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.612227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.614237 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.615874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6666f5e3-4ddd-435c-8241-1b33ddd6a8d9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.206864 Jan 19 01:02:48.616458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 367/694] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:48.621062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.621707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.628248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.628710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.629533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.629982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.675845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-288b57c6-468c-4c7f-9970-a2e2ab34e1b3 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 204 len: 0 microversion: 2.1 time: 0.156741 Jan 19 01:02:48.676438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 328/695] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:02:48 2022] DELETE /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 01:02:48.687110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.687851 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.697329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.697819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.698640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.699081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.791383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.805195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ca5d8950-ed15-43ab-a2f3-2671b20235fe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1594 microversion: 2.1 time: 0.187497 Jan 19 01:02:48.806341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 368/696] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1594 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:48.857955 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:48.866607 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8e0d7ac6-3c62-4723-abbf-967ab784e5d7 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.183511 Jan 19 01:02:48.867118 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 329/697] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:48.956427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:48.957302 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:48.963365 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.963817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:48.964617 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:48.965054 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.127986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.138549 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c5af2560-a96a-4445-a2bc-ff08c0802fcf tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1442 microversion: 2.1 time: 0.185863 Jan 19 01:02:49.139340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 369/698] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:48 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1442 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:49.162479 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:49.163649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:49.178026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.178772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.180315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.181078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.285649 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:49.286281 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:49.292395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.292871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.293692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.294138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.406734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.428021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-38df8719-fb4a-4f7a-923b-786c3afb4687 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1442 microversion: 2.1 time: 0.271029 Jan 19 01:02:49.430298 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 330/699] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:49 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1442 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:49.463503 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.472454 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-47476591-4551-4383-9d71-4a17fdacb10c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.190936 Jan 19 01:02:49.473085 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 370/700] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:49 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:49.635589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:49.640459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:49.648196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.649349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.651601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.653152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.884994 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:49.885629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:49.893213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.893992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.894802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:49.895439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:49.951591 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.963371 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.965030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:49.966534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4c76af4b-cadd-4504-b571-55cd3e1851e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.334738 Jan 19 01:02:49.974506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 331/701] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:49 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:50.156015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:50.166400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e93d7af1-4c73-40c2-b3bd-47219063cbde tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.284101 Jan 19 01:02:50.167028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 371/702] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:49 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:50.497982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:50.499229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:50.506744 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:50.507196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:50.508188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:50.508666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:50.803217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:50.811179 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-59a1bf41-3eb3-4512-8cf1-6d1483defc67 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.317263 Jan 19 01:02:50.821030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 332/703] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:50 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:50.984562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:50.985187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:50.992218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:50.992941 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:50.993989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:50.994615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.195060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:51.195725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:51.202956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.204565 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.205493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.206057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.487821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:51.503406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:51.506641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:51.508334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2bb39769-082f-4798-88f5-c6065c8bb66a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.527777 Jan 19 01:02:51.509273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 372/704] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:50 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:51.771448 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:51.787050 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1b13287a-2a49-41a0-b58e-3fd02a6699a6 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.603528 Jan 19 01:02:51.787903 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 333/705] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:51 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:51.812145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-2a60b5cf-f54e-4d85-a9de-a0ba308334a0 req-1d4b861d-ae06-46ee-b475-202adcf9c296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:51.815561 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:51.815561 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:51.829186 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:51.831471 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:51.843049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-2a60b5cf-f54e-4d85-a9de-a0ba308334a0 req-1d4b861d-ae06-46ee-b475-202adcf9c296 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.843821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-2a60b5cf-f54e-4d85-a9de-a0ba308334a0 req-1d4b861d-ae06-46ee-b475-202adcf9c296 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.853976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.855158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.862153 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.862912 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.876590 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-2a60b5cf-f54e-4d85-a9de-a0ba308334a0 req-1d4b861d-ae06-46ee-b475-202adcf9c296 service nova] Creating event network-changed:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:02:51.890726 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-2a60b5cf-f54e-4d85-a9de-a0ba308334a0 req-1d4b861d-ae06-46ee-b475-202adcf9c296 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087167 Jan 19 01:02:51.891384 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 373/706] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:51.934972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-fc90a474-30fe-40a1-af2d-1f6764dab438 req-b81b51bf-5180-4638-b1f5-d1e697fb0617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "name": "network-vif-plugged", "status": "completed", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:51.936771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:51.936771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:51.949373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-fc90a474-30fe-40a1-af2d-1f6764dab438 req-b81b51bf-5180-4638-b1f5-d1e697fb0617 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:51.949866 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-fc90a474-30fe-40a1-af2d-1f6764dab438 req-b81b51bf-5180-4638-b1f5-d1e697fb0617 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:51.970552 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-fc90a474-30fe-40a1-af2d-1f6764dab438 req-b81b51bf-5180-4638-b1f5-d1e697fb0617 service nova] Creating event network-vif-plugged:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 01:02:51.977499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-fc90a474-30fe-40a1-af2d-1f6764dab438 req-b81b51bf-5180-4638-b1f5-d1e697fb0617 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046994 Jan 19 01:02:51.978856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 374/707] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:52.234631 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:52.258147 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9cb78139-e756-4e32-ade2-a1c32fabc227 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.430367 Jan 19 01:02:52.259424 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 334/708] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:51 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:52.532835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:52.533611 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:52.545399 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:52.546293 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:52.548657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:52.551218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:52.847613 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:52.850896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:52.872827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:52.873742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:52.876737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:52.878006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:52.975360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:53.004928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:53.017722 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:53.020681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-87322063-33a1-4600-9ba6-754f4a69a547 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.493204 Jan 19 01:02:53.027324 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 375/709] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:52 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:53.058241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-cb43224e-6674-4d0b-a235-43ef59e81b67 req-2dc72ba7-1e34-42b5-834f-dc451905bfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:53.061766 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:53.061766 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:53.087245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-cb43224e-6674-4d0b-a235-43ef59e81b67 req-2dc72ba7-1e34-42b5-834f-dc451905bfef service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:53.088136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-cb43224e-6674-4d0b-a235-43ef59e81b67 req-2dc72ba7-1e34-42b5-834f-dc451905bfef service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:53.123807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-cb43224e-6674-4d0b-a235-43ef59e81b67 req-2dc72ba7-1e34-42b5-834f-dc451905bfef service nova] Creating event network-changed:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:02:53.135989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-cb43224e-6674-4d0b-a235-43ef59e81b67 req-2dc72ba7-1e34-42b5-834f-dc451905bfef service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082559 Jan 19 01:02:53.137231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 376/710] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:53.157196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:53.166816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-72464a5c-0c49-4eb3-8e58-1f7fcb1abf11 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.354371 Jan 19 01:02:53.168799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 335/711] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:52 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:53.310140 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:53.311798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:53.330989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:53.334977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:53.338188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:53.339194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:53.825847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:53.835940 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-511ded22-419f-43e1-9bf5-7fc8b50f5312 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.544873 Jan 19 01:02:53.846893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 377/712] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:53 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:54.024202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2019152140"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:54.026611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:54.040403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.041399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.042713 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.043643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.073336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:54.075261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:54.090304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.091505 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.093102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.094124 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.334160 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:54.343218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:54.344840 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:54.346115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-caac28db-dc20-47f1-bc6c-3e752d1395d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.281174 Jan 19 01:02:54.357325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 378/713] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:54 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:54.357523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.network.security_group_api [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Adding security group b299d5c3-3091-4714-8992-7998dee44112 to port 9758b8ed-8939-4a51-8bec-bc88b27b6d7d Jan 19 01:02:54.366745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:54.367949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:54.374487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.375219 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.376759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.377208 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.552754 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:54.564968 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7b6ed0fe-197d-4d0c-9341-e09b80b35288 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.205399 Jan 19 01:02:54.566760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 379/714] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:54 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:54.854459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:54.856222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:54.865348 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2a84c159-f62d-43bb-ab9f-bffaf5b0a92b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action" status: 202 len: 0 microversion: 2.1 time: 0.850388 Jan 19 01:02:54.866369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 336/715] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:02:54 2022] POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:02:54.867596 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.868063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.868897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.874206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.878803 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:54.879720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:54.895247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.896242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:54.898072 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:54.899126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.097918 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.107316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2d6622d8-09ed-4d2b-a63d-f95b4da89636 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.256466 Jan 19 01:02:55.116733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 380/716] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:54 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:55.126558 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-5f289b4c-eb3b-47c0-8124-9d66e73ecd23 req-f080abca-ffee-4b94-9cc0-c65115e052c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:02:55.129659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:02:55.129659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:02:55.140008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-5f289b4c-eb3b-47c0-8124-9d66e73ecd23 req-f080abca-ffee-4b94-9cc0-c65115e052c6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:55.140299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.140787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-5f289b4c-eb3b-47c0-8124-9d66e73ecd23 req-f080abca-ffee-4b94-9cc0-c65115e052c6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.149774 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2bf46773-a82e-40da-9f78-2fffbd64647a tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1759 microversion: 2.1 time: 0.279312 Jan 19 01:02:55.150725 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 337/717] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:54 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1759 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:55.158719 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-5f289b4c-eb3b-47c0-8124-9d66e73ecd23 req-f080abca-ffee-4b94-9cc0-c65115e052c6 service nova] Creating event network-changed:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:02:55.165518 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-5f289b4c-eb3b-47c0-8124-9d66e73ecd23 req-f080abca-ffee-4b94-9cc0-c65115e052c6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047098 Jan 19 01:02:55.166677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 381/718] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:55.373076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:55.375073 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:55.389873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:55.391296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.392794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:55.393962 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.604309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:55.606398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:55.619820 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:55.620711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.621882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:55.622568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:55.741983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.757022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.760322 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.762736 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-506c65b9-8d41-42b6-9840-ce7e95d3844a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.397898 Jan 19 01:02:55.778070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 338/719] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:55 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:55.861014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:55.877418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-14a53261-3626-4270-a366-828b24f2c5ec tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.290636 Jan 19 01:02:55.878139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 382/720] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:55 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:56.127219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:56.128114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:56.135661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.135661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.136285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.136796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.290870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:56.300502 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-70b6f8e9-00fc-49c2-a69e-6aa0539fcac3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.177158 Jan 19 01:02:56.301116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 339/721] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:56 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:56.709973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:56.710475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:56.716871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.717411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.718326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.718862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.790907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:56.791523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:56.796867 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lazy-loading 'services' on Instance uuid 6f94565c-3ebb-44c9-affe-c5060f9e695c {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:02:56.797321 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.797816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.798596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.799034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.879624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e762489f-0a37-43d4-9998-42873bdcd8c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments/7a736a9e-0a87-49a3-813f-9a7b786751b4" status: 202 len: 0 microversion: 2.1 time: 0.172815 Jan 19 01:02:56.880442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 383/722] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:02:56 2022] DELETE /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments/7a736a9e-0a87-49a3-813f-9a7b786751b4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:02:56.895280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:56.895947 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:56.905646 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.906884 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.907788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.908530 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.944005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-05bf9520-c827-45af-8e64-cc9d1ef0165c tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057280 Jan 19 01:02:56.944749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 384/723] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:56 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:56.949657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:56.950301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:56.956639 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.957099 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.957948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:56.958404 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:56.964196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:56.973719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:56.975314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:56.976618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e90c00fe-1b78-4183-afc8-19a7ba3e410f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.189361 Jan 19 01:02:56.977285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 340/724] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:56 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:02:57.117475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:57.125005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8f35b5dd-6ebc-40d9-8785-181f4dbe9bd2 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.179189 Jan 19 01:02:57.126181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 385/725] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:56 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:57.317933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:57.318550 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:57.324947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:57.325402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:57.326230 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:57.326672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:57.463699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:57.472004 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6a28046d-17c5-455f-8b9e-4f2724c672c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.157777 Jan 19 01:02:57.472601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 341/726] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:57 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:57.956215 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:57.957153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:57.964414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:57.964824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:57.965657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:57.966095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.000045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:58.000968 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4f9f0658-434d-47a5-acd5-bc05194efcf9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Jan 19 01:02:58.001190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:58.001607 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 386/727] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:57 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:02:58.009044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.009592 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.010451 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.010947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.144647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:58.145681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:58.154958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.155420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.156619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.157354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.175630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:58.185390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:58.186948 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:58.188664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6a0a26f5-289e-494c-9af9-18a46030559a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1809 microversion: 2.20 time: 0.192830 Jan 19 01:02:58.189233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 342/728] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:57 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:58.321060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:58.330701 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1e84a5d0-02ac-45e6-830c-9573cb18011e tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.191819 Jan 19 01:02:58.331296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 387/729] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:58 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:58.498618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:58.500019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:58.507477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.507923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.508740 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.509179 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.657638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:58.665212 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8348cec8-f0fd-41a2-b522-2f648e07ef25 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.174952 Jan 19 01:02:58.665828 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 343/730] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:58 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:58.883365 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:58.883893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:58.890001 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.890459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.891257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:58.891693 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:58.924692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:02:59.012652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:59.013853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:59.020094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.020551 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.021363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.021845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.032252 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4754306c-6b7d-4816-9445-5c9c8b61aa17 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 204 len: 0 microversion: 2.1 time: 0.151645 Jan 19 01:02:59.033136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 388/731] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:02:58 2022] DELETE /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:02:59.041139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:59.041869 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:59.048794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.049246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.050328 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.050769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.062541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f42add16-5fed-4259-8a76-b824c0a7bbbe tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Jan 19 01:02:59.067167 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 344/732] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:02:59 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:02:59.191905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.200684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4ebef928-cf7b-497f-b8b8-374fa60fd537 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1515 microversion: 2.1 time: 0.162474 Jan 19 01:02:59.200684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 389/733] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:59 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:02:59.212864 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:59.214129 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:59.222881 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.223323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.224175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.224615 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.350731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:59.351640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:59.359231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.360008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.361407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.362253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.386829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.400182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.403372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.403372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4ed49a74-e09c-438e-bb8c-673c722d9371 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1796 microversion: 2.20 time: 0.196795 Jan 19 01:02:59.406137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 345/734] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:02:59 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1796 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:02:59.532502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.543706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-74962e3c-5bd4-42e3-b5a9-c7941a362468 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1520 microversion: 2.1 time: 0.197909 Jan 19 01:02:59.544759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 390/735] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:59 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:02:59.682920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:02:59.683728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:02:59.691313 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.691808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.692590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:02:59.693224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:02:59.915148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:02:59.923976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cfb83288-7fe8-4ef5-804d-aeda3724f14d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1673 microversion: 2.1 time: 0.244675 Jan 19 01:02:59.924654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 346/736] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:02:59 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:00.063795 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-8de9fe8b-e19b-4026-bee9-d5bcaf662005 req-c8dd5d95-0668-4f25-9290-573c20814c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e02678-2973-4080-be5a-b589dd630ec9", "name": "network-vif-deleted", "tag": "1c132cd5-f5f6-4711-b7a1-f2914b638f73"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:00.065467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:00.065467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:00.074067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-8de9fe8b-e19b-4026-bee9-d5bcaf662005 req-c8dd5d95-0668-4f25-9290-573c20814c26 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.074508 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-8de9fe8b-e19b-4026-bee9-d5bcaf662005 req-c8dd5d95-0668-4f25-9290-573c20814c26 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.076981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:00.077995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:00.086521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.086806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-8de9fe8b-e19b-4026-bee9-d5bcaf662005 req-c8dd5d95-0668-4f25-9290-573c20814c26 service nova] Creating event network-vif-deleted:1c132cd5-f5f6-4711-b7a1-f2914b638f73 for instance b1e02678-2973-4080-be5a-b589dd630ec9 on hv-cinder-79987 Jan 19 01:03:00.087025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.088397 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.088845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.091719 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-8de9fe8b-e19b-4026-bee9-d5bcaf662005 req-c8dd5d95-0668-4f25-9290-573c20814c26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Jan 19 01:03:00.092590 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 391/737] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:03:00.122847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dca429fe-698b-4385-8d34-02063a961c91 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050705 Jan 19 01:03:00.123560 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 347/738] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:03:00 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 01:03:00.218140 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:00.218931 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:00.225989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.226758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.227775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.228363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.405418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:00.412140 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6cc10a9b-4366-4dea-8d02-f69a62a87c67 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1515 microversion: 2.1 time: 0.198424 Jan 19 01:03:00.413349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 392/739] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:00 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:00.561346 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:00.562042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:00.568482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.568939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.569802 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.570285 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.604161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.604608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.605074 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lazy-loading 'fault' on Instance uuid b1e02678-2973-4080-be5a-b589dd630ec9 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:03:00.686583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57ab063194724671a902d8ce8313bfc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99fc8541ea44ac9fae068411d73f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:00.694966 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e043ad77-0460-4f71-a594-6db1004f5b8f tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 200 len: 1311 microversion: 2.1 time: 0.137361 Jan 19 01:03:00.695559 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 348/740] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:00 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:00.942559 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:00.943101 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:00.949041 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.949491 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:00.950308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:00.950748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.097436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:01.105200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-46207c9a-2682-48ce-8bcb-d21c6007aa56 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1650 microversion: 2.1 time: 0.166461 Jan 19 01:03:01.105823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 393/741] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:00 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1650 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:01.122125 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f95c48ae-e02e-4eb3-8c3c-8ed4aee6e325 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:01.128922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f95c48ae-e02e-4eb3-8c3c-8ed4aee6e325 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.129374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f95c48ae-e02e-4eb3-8c3c-8ed4aee6e325 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.153345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f95c48ae-e02e-4eb3-8c3c-8ed4aee6e325 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Going to try to start instance {{(pid=116543) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 01:03:01.198000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f95c48ae-e02e-4eb3-8c3c-8ed4aee6e325 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action" status: 202 len: 0 microversion: 2.1 time: 0.079293 Jan 19 01:03:01.198528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 349/742] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:03:01 2022] POST /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:03:01.207152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:01.208354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:01.215559 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.216022 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.216933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.217374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.340282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:01.341182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:01.348043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.348503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.349307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.349787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.365017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:01.374403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1070f90c-01e8-45fc-ba2c-f1838487fc0f tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1659 microversion: 2.1 time: 0.171444 Jan 19 01:03:01.374995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 394/743] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:01 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1659 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:01.379082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:03:01.429749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:01.430475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:01.436835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.438298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.439358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.440026 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.491608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bb0e6e58-cdce-4dfb-b1b1-cd058a3708b9 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 204 len: 0 microversion: 2.1 time: 0.155067 Jan 19 01:03:01.492710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 350/744] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:03:01 2022] DELETE /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 01:03:01.502748 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:01.503760 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:01.510327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.510776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.511574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.512032 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.598000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:01.605714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a5ea461d-1538-49a9-b40f-7629786b85e6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1515 microversion: 2.1 time: 0.179585 Jan 19 01:03:01.606324 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 395/745] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:01 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:01.680337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:01.688585 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-25a54f5e-568e-4180-ac19-2340a676772f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1514 microversion: 2.1 time: 0.189919 Jan 19 01:03:01.689331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 351/746] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:01 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:01.713828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:01.713828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] [instance: b1e02678-2973-4080-be5a-b589dd630ec9] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:01.723944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.724961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.726638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:01.727642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:01.757791 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] HTTP exception thrown: Instance b1e02678-2973-4080-be5a-b589dd630ec9 could not be found. Jan 19 01:03:01.759136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] Returning 404 to user: Instance b1e02678-2973-4080-be5a-b589dd630ec9 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:01.760412 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fb790b8c-f27e-4a79-8507-84b39e01d5d8 tempest-ServerRescueNegativeTestJSON-1871241683 tempest-ServerRescueNegativeTestJSON-1871241683-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9" status: 404 len: 111 microversion: 2.1 time: 0.051280 Jan 19 01:03:01.761806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 396/747] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:01 2022] GET /compute/v2.1/servers/b1e02678-2973-4080-be5a-b589dd630ec9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:03:02.394660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:02.395843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:02.408124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.409125 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.410818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.411452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.589225 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:02.599718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2c7f4c63-0377-4bda-9064-395113c00ad3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1659 microversion: 2.1 time: 0.210889 Jan 19 01:03:02.600749 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 352/748] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:02 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1659 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:02.624042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:02.624673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:02.632097 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.632559 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.633378 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.633849 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.706169 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:02.706794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:02.713182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.713665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.714474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.714973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.717152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:02.725419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bda8b38c-1161-407e-86c4-c29e0bbacb6f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 200 len: 1473 microversion: 2.1 time: 0.105006 Jan 19 01:03:02.736948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 397/749] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:02 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 1473 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:02.895792 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-8e2a9394-06d9-4f10-9279-32f20f7ab0de req-74f6931f-1c6f-4296-9565-87b4a92475ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca39699-5b1c-41e3-8fbe-4b914265d69f", "name": "network-vif-deleted", "tag": "5f884301-077e-4a7e-abc4-146c5797b4ca"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:02.897901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:02.897901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:02.912905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-8e2a9394-06d9-4f10-9279-32f20f7ab0de req-74f6931f-1c6f-4296-9565-87b4a92475ca service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:02.913485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-8e2a9394-06d9-4f10-9279-32f20f7ab0de req-74f6931f-1c6f-4296-9565-87b4a92475ca service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:02.913700 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:02.931531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-8e2a9394-06d9-4f10-9279-32f20f7ab0de req-74f6931f-1c6f-4296-9565-87b4a92475ca service nova] Creating event network-vif-deleted:5f884301-077e-4a7e-abc4-146c5797b4ca for instance aca39699-5b1c-41e3-8fbe-4b914265d69f on hv-cinder-79987 Jan 19 01:03:02.932519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bc1b879d-f544-44d8-9863-3e39537a6571 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1514 microversion: 2.1 time: 0.231177 Jan 19 01:03:02.934603 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 353/750] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:02 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:02.939435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-8e2a9394-06d9-4f10-9279-32f20f7ab0de req-74f6931f-1c6f-4296-9565-87b4a92475ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065741 Jan 19 01:03:02.940413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 398/751] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:03:03.617675 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:03.618248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:03.624398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.625138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:03.625965 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.626719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:03.751773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:03.752489 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: aca39699-5b1c-41e3-8fbe-4b914265d69f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:03.759454 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.759915 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:03.760732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.761178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:03.775452 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] HTTP exception thrown: Instance aca39699-5b1c-41e3-8fbe-4b914265d69f could not be found. Jan 19 01:03:03.776314 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Returning 404 to user: Instance aca39699-5b1c-41e3-8fbe-4b914265d69f could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:03.776529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:03.777455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f3c7ad98-03dd-40bf-a093-c7374abfa4d6 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f" status: 404 len: 111 microversion: 2.1 time: 0.029649 Jan 19 01:03:03.778806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 399/752] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:03 2022] GET /compute/v2.1/servers/aca39699-5b1c-41e3-8fbe-4b914265d69f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:03:03.794747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9be13388-7305-4c49-9e9f-e3261a819e0a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1663 microversion: 2.1 time: 0.180552 Jan 19 01:03:03.795694 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 354/753] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:03 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:03.952520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:03.954406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:03.962490 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.963386 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:03.964821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:03.965922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:04.483424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:04.493633 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-57c564d2-4482-423e-a439-bf6a4338f9d0 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1514 microversion: 2.1 time: 0.544885 Jan 19 01:03:04.494233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 400/754] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:03 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1514 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:05.511339 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:05.511975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:05.521508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:05.522239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:05.523579 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:05.524267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:05.767769 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:05.776715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-32f30329-ee7d-435a-b2c0-73de4d6ec775 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1514 microversion: 2.1 time: 0.269068 Jan 19 01:03:05.778732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 355/755] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:05 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:05.877297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-6a0258fd-3866-438b-a3b4-d3edf472eb07 req-64e20c4e-60ef-40cf-9605-89aa29ad2c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f94565c-3ebb-44c9-affe-c5060f9e695c", "name": "network-vif-deleted", "tag": "284f59e4-d32f-4e98-adc8-83e29a3730d5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:05.879106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:05.879106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:05.887426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-6a0258fd-3866-438b-a3b4-d3edf472eb07 req-64e20c4e-60ef-40cf-9605-89aa29ad2c52 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:05.887873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-6a0258fd-3866-438b-a3b4-d3edf472eb07 req-64e20c4e-60ef-40cf-9605-89aa29ad2c52 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:05.900107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-6a0258fd-3866-438b-a3b4-d3edf472eb07 req-64e20c4e-60ef-40cf-9605-89aa29ad2c52 service nova] Creating event network-vif-deleted:284f59e4-d32f-4e98-adc8-83e29a3730d5 for instance 6f94565c-3ebb-44c9-affe-c5060f9e695c on hv-cinder-79987 Jan 19 01:03:05.906060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-6a0258fd-3866-438b-a3b4-d3edf472eb07 req-64e20c4e-60ef-40cf-9605-89aa29ad2c52 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Jan 19 01:03:05.906863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 401/756] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:03:06.796325 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:06.797644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:06.809425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:06.810218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:06.811425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:06.812178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:06.891173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:06.900075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4af3edd4-740b-4243-b62e-51c808138cd2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 200 len: 1472 microversion: 2.1 time: 0.109730 Jan 19 01:03:06.900947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 356/757] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:06 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 1472 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:07.820620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-954ee629-7f65-4616-8e43-87b204d0f907 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Action: 'create', calling method: .version_select at 0x7f9351275820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1975512880", "metadata": {"Type": "work"}}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:07.822094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-954ee629-7f65-4616-8e43-87b204d0f907 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.822908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-954ee629-7f65-4616-8e43-87b204d0f907 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149005 Jan 19 01:03:07.823457 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 402/758] 10.222.0.35 () {60 vars in 1155 bytes} [Wed Jan 19 01:03:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 19 01:03:07.832503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0cde0b86-cfdc-4be5-9434-aa25a7f26552 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Action: 'create', calling method: .version_select at 0x7f934c6abdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1549603558", "metadata": {"Type": "work"}}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:07.834001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0cde0b86-cfdc-4be5-9434-aa25a7f26552 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.834796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0cde0b86-cfdc-4be5-9434-aa25a7f26552 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005989 Jan 19 01:03:07.835348 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 357/759] 10.222.0.35 () {60 vars in 1155 bytes} [Wed Jan 19 01:03:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:03:07.844605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-de320c86-6794-45fb-bda8-8743b19236d4 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Action: 'create', calling method: .version_select at 0x7f93511e33a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1199136332", "metadata": {"Type": "work"}}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:07.845791 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-de320c86-6794-45fb-bda8-8743b19236d4 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.846572 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-de320c86-6794-45fb-bda8-8743b19236d4 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006140 Jan 19 01:03:07.847092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 403/760] 10.222.0.35 () {60 vars in 1155 bytes} [Wed Jan 19 01:03:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:03:07.856106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4b947dc3-80ec-408e-b1c4-0c5d124b3ff8 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Calling method '.version_select at 0x7f934c672160>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:07.890570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-4b947dc3-80ec-408e-b1c4-0c5d124b3ff8 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] HTTP exception thrown: Volume tempest-invalid-596845697 could not be found. Jan 19 01:03:07.891226 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4b947dc3-80ec-408e-b1c4-0c5d124b3ff8 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 404 to user: Volume tempest-invalid-596845697 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.892283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4b947dc3-80ec-408e-b1c4-0c5d124b3ff8 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-596845697" status: 404 len: 98 microversion: 2.1 time: 0.040068 Jan 19 01:03:07.893187 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 358/761] 10.222.0.35 () {58 vars in 1214 bytes} [Wed Jan 19 01:03:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-596845697 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 19 01:03:07.908922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dcc5d865-5a45-4244-8c4c-c1a2229ce39d tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006408 Jan 19 01:03:07.909909 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 404/762] 10.222.0.35 () {58 vars in 1139 bytes} [Wed Jan 19 01:03:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 01:03:07.919615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:07.920382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 6f94565c-3ebb-44c9-affe-c5060f9e695c] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:07.922716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-331f9868-357b-46fb-9d60-cae9edc97290 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005733 Jan 19 01:03:07.923566 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 359/763] 10.222.0.35 () {58 vars in 1136 bytes} [Wed Jan 19 01:03:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 01:03:07.927986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:07.928451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:07.929332 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:07.929804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:07.938064 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-013cf852-e95b-4659-94eb-0322e00701af tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Calling method '.version_select at 0x7f934c6ab040>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:07.944333 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Instance 6f94565c-3ebb-44c9-affe-c5060f9e695c could not be found. Jan 19 01:03:07.944946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 404 to user: Instance 6f94565c-3ebb-44c9-affe-c5060f9e695c could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.945842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3ab1a010-f690-406e-9716-2efcef5ef237 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c" status: 404 len: 111 microversion: 2.1 time: 0.030004 Jan 19 01:03:07.946421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 405/764] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:07 2022] GET /compute/v2.1/servers/6f94565c-3ebb-44c9-affe-c5060f9e695c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:03:07.972328 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-013cf852-e95b-4659-94eb-0322e00701af tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] HTTP exception thrown: Volume c845daab-59b8-4628-956b-2432f9e67e8a could not be found. Jan 19 01:03:07.972933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-013cf852-e95b-4659-94eb-0322e00701af tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 404 to user: Volume c845daab-59b8-4628-956b-2432f9e67e8a could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:07.973807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-013cf852-e95b-4659-94eb-0322e00701af tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/c845daab-59b8-4628-956b-2432f9e67e8a" status: 404 len: 109 microversion: 2.1 time: 0.042662 Jan 19 01:03:07.974370 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 360/765] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 01:03:07 2022] DELETE /compute/v2.1/os-volumes/c845daab-59b8-4628-956b-2432f9e67e8a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:03:07.983434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b9955a0e-a621-45fb-8cfc-bb31cd717120 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Calling method '.version_select at 0x7f9351275820>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:08.022679 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-b9955a0e-a621-45fb-8cfc-bb31cd717120 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] HTTP exception thrown: Volume 7c15ab1c-f143-4dbc-b847-2871321870f2 could not be found. Jan 19 01:03:08.023923 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b9955a0e-a621-45fb-8cfc-bb31cd717120 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] Returning 404 to user: Volume 7c15ab1c-f143-4dbc-b847-2871321870f2 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:08.025873 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b9955a0e-a621-45fb-8cfc-bb31cd717120 tempest-VolumesNegativeTest-527750879 tempest-VolumesNegativeTest-527750879-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7c15ab1c-f143-4dbc-b847-2871321870f2" status: 404 len: 109 microversion: 2.1 time: 0.045729 Jan 19 01:03:08.027137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 406/766] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:03:07 2022] GET /compute/v2.1/os-volumes/7c15ab1c-f143-4dbc-b847-2871321870f2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:03:09.145527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:09.146354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:09.156715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:09.157524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:09.159017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:09.159756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:09.203877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:03:09.335953 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-60eb75be-c86f-4751-b2a7-98799124a80b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 204 len: 0 microversion: 2.1 time: 0.198847 Jan 19 01:03:09.336558 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 361/767] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:03:09 2022] DELETE /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:03:09.349769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:09.350543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:09.357326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:09.357815 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:09.358723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:09.359297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:09.542270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:09.561785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a6117916-8d57-48fc-8389-f9fea0ba643f tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1515 microversion: 2.1 time: 0.214237 Jan 19 01:03:09.561785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 407/768] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:09 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:10.582563 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:10.583432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:10.592542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:10.593402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:10.595364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:10.596124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:10.752709 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:10.761087 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6a7fd2dd-79ff-4e37-a962-e03c17bb8f5b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1515 microversion: 2.1 time: 0.184240 Jan 19 01:03:10.761894 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 362/769] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:10 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:11.779974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:11.781246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:11.788954 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:11.789569 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:11.790664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:11.791203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:11.964609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-126852989", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "networks": [{"uuid": "8550cd25-1ac0-43a3-a265-8e2a1781782d"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:12.004824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:12.017508 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4392dbc3-525e-475f-81e7-80a0fc88dc1e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1515 microversion: 2.1 time: 0.240707 Jan 19 01:03:12.022455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 408/770] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:11 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:12.045496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] validate_networks() for [('8550cd25-1ac0-43a3-a265-8e2a1781782d', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:03:12.736859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:03:12.737413 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:03:12.738015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:03:12.738513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:03:12.739016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:03:12.749007 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:12.749345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:12.750213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:12.750645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:12.769980 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Getting quotas for project ac73f1c040f94f43bcdd01f92771821e. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:03:12.774516 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Getting quotas for user 5a52500125c44ab5a9ffdb801248f33c and project ac73f1c040f94f43bcdd01f92771821e. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:03:12.787843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:03:12.790287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:03:12.842094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cebb4c3c-b7b0-4610-8c0f-34efc16b0af1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883338 Jan 19 01:03:12.843534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 363/771] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:03:12.861510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b6838473-b13b-4a50-a736-0863c95cf2d3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:12.862681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b6838473-b13b-4a50-a736-0863c95cf2d3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:12.968139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b6838473-b13b-4a50-a736-0863c95cf2d3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:12.985027 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b6838473-b13b-4a50-a736-0863c95cf2d3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1218 microversion: 2.1 time: 0.130589 Jan 19 01:03:12.986671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 409/772] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:12 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:13.051524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:13.052737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:13.064209 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:13.065258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:13.066827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:13.067591 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:13.314020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:13.325110 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-802db3bd-c9ea-49c8-ba77-6d7a8aafe452 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1515 microversion: 2.1 time: 0.281043 Jan 19 01:03:13.326302 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 364/773] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:13 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1515 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:14.015335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:14.016448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:14.033392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:14.034595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:14.036265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:14.037476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:14.162638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:14.180485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3704d459-6412-4d90-a23a-46e38300ef2f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1270 microversion: 2.1 time: 0.171604 Jan 19 01:03:14.196707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 410/774] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:14 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:14.351580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:14.353220 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:14.368567 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:14.371534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:14.373321 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:14.375819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:14.486742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-fa6cf3b5-12f4-49c5-9168-454c049f870a req-31b98658-24c3-45fb-85a1-714c9babebd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e12597-7db9-4c72-adc8-20270f7474f4", "name": "network-vif-deleted", "tag": "2af8b39b-1fd3-486d-b078-83ad1b5e7a78"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:14.499488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:14.499488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:14.512520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-fa6cf3b5-12f4-49c5-9168-454c049f870a req-31b98658-24c3-45fb-85a1-714c9babebd5 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:14.513898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-fa6cf3b5-12f4-49c5-9168-454c049f870a req-31b98658-24c3-45fb-85a1-714c9babebd5 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:14.545844 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:14.552371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-fa6cf3b5-12f4-49c5-9168-454c049f870a req-31b98658-24c3-45fb-85a1-714c9babebd5 service nova] Creating event network-vif-deleted:2af8b39b-1fd3-486d-b078-83ad1b5e7a78 for instance f9e12597-7db9-4c72-adc8-20270f7474f4 on hv-cinder-79987 Jan 19 01:03:14.563818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fb3db1a2-c35b-44b8-b6f9-a4b13c374cae tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 200 len: 1473 microversion: 2.1 time: 0.217250 Jan 19 01:03:14.567138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 365/775] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:14 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:14.568142 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-fa6cf3b5-12f4-49c5-9168-454c049f870a req-31b98658-24c3-45fb-85a1-714c9babebd5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084816 Jan 19 01:03:14.569325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 411/776] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:03:15.209340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:15.209984 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:15.219612 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.220083 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.220909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.221343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.540025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:15.553040 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bac64a5a-4123-4493-a5ea-0de2a108ff3e tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.349675 Jan 19 01:03:15.554071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 366/777] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:15 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:15.590574 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:15.592051 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: f9e12597-7db9-4c72-adc8-20270f7474f4] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:15.600152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.600950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.601844 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.602482 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.617795 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Instance f9e12597-7db9-4c72-adc8-20270f7474f4 could not be found. Jan 19 01:03:15.618440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 404 to user: Instance f9e12597-7db9-4c72-adc8-20270f7474f4 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:15.619295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-177a5f61-8bff-4c00-b09c-55b37a14f3c8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4" status: 404 len: 111 microversion: 2.1 time: 0.033381 Jan 19 01:03:15.619857 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 412/778] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:15 2022] GET /compute/v2.1/servers/f9e12597-7db9-4c72-adc8-20270f7474f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:03:15.628702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:15.629298 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:15.638237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.638838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.639680 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.640142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.670808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:03:15.791228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f8cd11f2-a3f2-43d7-985b-55b9980d1acf tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 204 len: 0 microversion: 2.1 time: 0.165863 Jan 19 01:03:15.791994 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 367/779] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:03:15 2022] DELETE /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:03:15.802424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:15.804842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:15.810766 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.811227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.812043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:15.813632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:15.977232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:15.985428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c54ca11a-01b1-416b-b115-3589c0218df3 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1513 microversion: 2.1 time: 0.187176 Jan 19 01:03:15.986129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 413/780] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:15 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:16.321600 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-403f621b-ed35-4b52-bb42-b77c8d0c1450 req-1c284592-6855-4314-b311-4558bdbde367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b3f56b-4925-42cd-a1c6-11e90d67ebdd", "tag": "955ca13d-bb47-49ba-964d-470483a9019e"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:16.323283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:16.323283 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:03:16.332433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-403f621b-ed35-4b52-bb42-b77c8d0c1450 req-1c284592-6855-4314-b311-4558bdbde367 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:16.333847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-403f621b-ed35-4b52-bb42-b77c8d0c1450 req-1c284592-6855-4314-b311-4558bdbde367 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:16.348434 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-403f621b-ed35-4b52-bb42-b77c8d0c1450 req-1c284592-6855-4314-b311-4558bdbde367 service nova] Creating event network-changed:955ca13d-bb47-49ba-964d-470483a9019e for instance c9b3f56b-4925-42cd-a1c6-11e90d67ebdd on hv-cinder-79987 Jan 19 01:03:16.353768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-403f621b-ed35-4b52-bb42-b77c8d0c1450 req-1c284592-6855-4314-b311-4558bdbde367 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036152 Jan 19 01:03:16.354402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 368/781] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:03:16.570866 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:16.571473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:16.577943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:16.578417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:16.579269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:16.579716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:16.774165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:16.786850 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a706b67b-4dca-4089-b7b4-e92b34963750 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.219426 Jan 19 01:03:16.787563 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 414/782] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:16 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:17.005097 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:17.006296 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:17.015263 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:17.015907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:17.016877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:17.017376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:17.264379 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:17.276878 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-69cb51a3-252c-449d-aaae-c201842774e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1513 microversion: 2.1 time: 0.276638 Jan 19 01:03:17.278298 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 369/783] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:16 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:17.803204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:17.803809 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:17.810794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:17.811241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:17.812035 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:17.813004 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:17.970366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:17.981008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6913af83-2d2a-4d2e-b1a4-12f38ab6111b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.181642 Jan 19 01:03:17.981927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 415/784] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:17 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:18.303449 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:18.304066 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:18.313734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:18.314189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:18.317795 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:18.323647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:18.408800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-f1d557f6-03cc-4688-9875-d4309851201b req-fdca2c86-dcc3-4319-b718-ddd39f660103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f35a8a-ede6-447d-ac17-3ada99f11829", "name": "network-vif-deleted", "tag": "c2be2345-4d5f-41d3-8dda-d7f97540e714"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:18.411527 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:18.411527 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:18.419424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-f1d557f6-03cc-4688-9875-d4309851201b req-fdca2c86-dcc3-4319-b718-ddd39f660103 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:18.419927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-f1d557f6-03cc-4688-9875-d4309851201b req-fdca2c86-dcc3-4319-b718-ddd39f660103 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:18.420640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:18.429013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-57d9d297-6779-436c-a700-0b1dd0d67be1 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 200 len: 1471 microversion: 2.1 time: 0.129422 Jan 19 01:03:18.430098 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 370/785] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:18 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 1471 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:18.432273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-f1d557f6-03cc-4688-9875-d4309851201b req-fdca2c86-dcc3-4319-b718-ddd39f660103 service nova] Creating event network-vif-deleted:c2be2345-4d5f-41d3-8dda-d7f97540e714 for instance 58f35a8a-ede6-447d-ac17-3ada99f11829 on hv-cinder-79987 Jan 19 01:03:18.438991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-f1d557f6-03cc-4688-9875-d4309851201b req-fdca2c86-dcc3-4319-b718-ddd39f660103 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033236 Jan 19 01:03:18.439600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 416/786] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:03:18.998245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:18.998872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:19.006759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:19.007237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:19.008065 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:19.008519 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:19.166365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:19.175308 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ec1662e4-b508-4d3c-9144-588b22b793b8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.180613 Jan 19 01:03:19.175897 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 371/787] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:18 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:19.453616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:19.454910 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 58f35a8a-ede6-447d-ac17-3ada99f11829] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:19.465467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:19.466329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:19.467894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:19.469145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:19.490034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Instance 58f35a8a-ede6-447d-ac17-3ada99f11829 could not be found. Jan 19 01:03:19.491301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 404 to user: Instance 58f35a8a-ede6-447d-ac17-3ada99f11829 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:19.492242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e45039da-243c-4d42-b76a-61a6f4dcafe2 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829" status: 404 len: 111 microversion: 2.1 time: 0.047323 Jan 19 01:03:19.493011 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 417/788] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:19 2022] GET /compute/v2.1/servers/58f35a8a-ede6-447d-ac17-3ada99f11829 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:03:20.192362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:20.193058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:20.201126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.201936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.202981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.203445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.350860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:20.358084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ab70c675-0eba-4a9c-a71a-3b70c8ddac49 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.170663 Jan 19 01:03:20.358659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 372/789] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:20 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:20.638805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:20.639309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:20.645624 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.646080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.646871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.647304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.677103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:03:20.770628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1ac1c800-4d56-42c1-b5d6-041a3544849e tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 204 len: 0 microversion: 2.1 time: 0.135152 Jan 19 01:03:20.771775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 418/790] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:03:20 2022] DELETE /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:03:20.780051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:20.780544 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:20.786648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.787089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.788014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:20.788539 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:20.926217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:20.933855 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-289e0acd-bfcb-45b7-a2a7-14a95cd7cf35 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1513 microversion: 2.1 time: 0.157457 Jan 19 01:03:20.934441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 373/791] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:20 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:21.376587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:21.377291 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:21.383256 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:21.383749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:21.384550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:21.384992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:21.539498 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:21.546970 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d111e512-c03c-41d6-9fbb-647b29ad2ed3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.174622 Jan 19 01:03:21.547567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 419/792] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:21 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:21.950492 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:21.951095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:21.958623 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:21.959068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:21.959874 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:21.960462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:22.111798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:22.131706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-de759456-e9a9-483e-a7fe-6e6f88b1b2cc tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1513 microversion: 2.1 time: 0.184713 Jan 19 01:03:22.132924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 374/793] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:21 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:22.390163 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-7981a6a5-03f4-4338-ab38-fdf301dbcb21 req-5d57eb41-47c0-4214-ba61-97d1202157e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b3f56b-4925-42cd-a1c6-11e90d67ebdd", "name": "network-vif-plugged", "status": "completed", "tag": "955ca13d-bb47-49ba-964d-470483a9019e"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:22.391896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:22.391896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:03:22.399328 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-7981a6a5-03f4-4338-ab38-fdf301dbcb21 req-5d57eb41-47c0-4214-ba61-97d1202157e3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:22.399779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-7981a6a5-03f4-4338-ab38-fdf301dbcb21 req-5d57eb41-47c0-4214-ba61-97d1202157e3 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:22.412107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-7981a6a5-03f4-4338-ab38-fdf301dbcb21 req-5d57eb41-47c0-4214-ba61-97d1202157e3 service nova] Creating event network-vif-plugged:955ca13d-bb47-49ba-964d-470483a9019e for instance c9b3f56b-4925-42cd-a1c6-11e90d67ebdd on hv-cinder-79987 Jan 19 01:03:22.416978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-7981a6a5-03f4-4338-ab38-fdf301dbcb21 req-5d57eb41-47c0-4214-ba61-97d1202157e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030556 Jan 19 01:03:22.418184 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 420/794] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:03:22.564366 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:22.565223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:22.574189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:22.574858 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:22.575742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:22.576232 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:22.792365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:22.800022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f400aff6-1fe1-494f-af30-1f9b4c2297f9 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.239399 Jan 19 01:03:22.800627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 375/795] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:22 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:23.155217 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:23.156581 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:23.163527 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:23.163976 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:23.164760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:23.165204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:23.306907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:23.315646 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c2f80f97-53bc-4e39-8c0d-cc4297012e1b tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1513 microversion: 2.1 time: 0.164356 Jan 19 01:03:23.316268 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 421/796] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:23 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:23.779527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-b720e34a-1328-4330-8311-4435ddb64fa7 req-2ef35e16-c141-432f-bd69-0b890a6dcf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a211ed3-91b3-49a8-8ccd-fe71a9359bfd", "name": "network-vif-deleted", "tag": "48d03b9f-93ff-487d-8eb8-b6d6155cceb0"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:23.781187 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:03:23.781187 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:03:23.789470 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-b720e34a-1328-4330-8311-4435ddb64fa7 req-2ef35e16-c141-432f-bd69-0b890a6dcf15 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:23.789934 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-b720e34a-1328-4330-8311-4435ddb64fa7 req-2ef35e16-c141-432f-bd69-0b890a6dcf15 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:23.804912 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-b720e34a-1328-4330-8311-4435ddb64fa7 req-2ef35e16-c141-432f-bd69-0b890a6dcf15 service nova] Creating event network-vif-deleted:48d03b9f-93ff-487d-8eb8-b6d6155cceb0 for instance 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd on hv-cinder-79987 Jan 19 01:03:23.811960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-b720e34a-1328-4330-8311-4435ddb64fa7 req-2ef35e16-c141-432f-bd69-0b890a6dcf15 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035803 Jan 19 01:03:23.817995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 376/797] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:03:23.823494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:23.824655 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:23.834626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:23.835524 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:23.837689 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:23.838628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:24.038653 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:24.057397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2845408b-daa3-400b-a5c9-c7e37a9278f8 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1318 microversion: 2.1 time: 0.242401 Jan 19 01:03:24.058421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 422/798] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:23 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:24.337407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:24.338144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:24.344635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:24.345078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:24.345906 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:24.346335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:24.380233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:24.380680 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:24.381136 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lazy-loading 'fault' on Instance uuid 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:03:24.422904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46dddae0c2347d399239aaee9b2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501a962e9fd5449fb8b625403e9ff8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:24.430775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-089c1cec-fe92-4491-b52d-640009df44f8 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 200 len: 1307 microversion: 2.1 time: 0.097390 Jan 19 01:03:24.431365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 377/799] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:24 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:25.084665 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:25.085285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:25.093147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.094191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.095007 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.095447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.431105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:25.442638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e19fc46c-7009-4c41-ae49-01ba4169641a tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1507 microversion: 2.1 time: 0.361465 Jan 19 01:03:25.452093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 423/800] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:25 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:25.457546 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:25.458697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] [instance: 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:25.459589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd77fd4b-6960-4efc-8525-6c8afc23f715", "device": "/dev/sdb"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:25.461371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:25.466861 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.467462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.468385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.469003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.476180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.477027 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.478495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:25.478954 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:25.492627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] HTTP exception thrown: Instance 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd could not be found. Jan 19 01:03:25.494088 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] Returning 404 to user: Instance 2a211ed3-91b3-49a8-8ccd-fe71a9359bfd could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:03:25.495391 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-beb44ae2-76ab-412e-9199-cd577212c5e4 tempest-AttachVolumeNegativeTest-929944859 tempest-AttachVolumeNegativeTest-929944859-project] 10.222.0.35 "GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd" status: 404 len: 111 microversion: 2.1 time: 0.050465 Jan 19 01:03:25.496839 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 378/801] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:25 2022] GET /compute/v2.1/servers/2a211ed3-91b3-49a8-8ccd-fe71a9359bfd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:03:25.847845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f9d2a16b-21ec-4902-b1a8-6a27ee1a74cd tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "POST /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391557 Jan 19 01:03:25.848748 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 424/802] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:03:25 2022] POST /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:03:34.858706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:03:34.860959 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:34.868647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:34.869040 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:34.869915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:34.870322 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:34.954054 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f896eaa1-9e5f-4636-b20c-b156f8f63670 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action" status: 202 len: 0 microversion: 2.1 time: 0.099132 Jan 19 01:03:34.954672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 379/803] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:03:34 2022] POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:03:34.964382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:34.965785 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:34.972562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:34.973016 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:34.974046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:34.974512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:35.147143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:35.155279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7210089d-3f17-4156-94ca-a41ee56b59df tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1751 microversion: 2.1 time: 0.195458 Jan 19 01:03:35.156439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 425/804] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:34 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:36.173618 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:36.174315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:36.181637 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:36.182088 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:36.182874 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:36.183318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:36.354968 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:36.363521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f945fde2-d5e1-4e18-b12a-fd2b0f7b032c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1751 microversion: 2.1 time: 0.194438 Jan 19 01:03:36.364105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 380/805] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:36 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:37.381637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:37.382486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:37.389427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:37.390115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:37.391734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:37.392462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:37.566275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:37.575824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-af00c7d9-4691-4690-8395-8fd424580016 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1751 microversion: 2.1 time: 0.197883 Jan 19 01:03:37.576441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 426/806] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:37 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:03:38.603018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:38.604834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:38.611817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:38.612914 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:38.613969 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:38.614407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:38.801742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:38.812572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8fa05b63-76f1-48ac-85a5-e7950c88c5ec tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1751 microversion: 2.1 time: 0.214402 Jan 19 01:03:38.813173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 381/807] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:38 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:39.830143 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:39.830854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:39.840335 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:39.840793 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:39.841625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:39.842068 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:39.999699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:40.009336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-635553e9-661d-4212-96f7-9a701a74ab8d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1751 microversion: 2.1 time: 0.182828 Jan 19 01:03:40.010191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 427/808] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:39 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:41.027678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:41.028365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:41.035131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:41.035662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:41.036532 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:41.037044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:41.185306 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:41.193152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-55a78237-b8ca-48cb-8b74-b4dd61cd5d1c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.169799 Jan 19 01:03:41.193843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 382/809] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:41 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:42.211812 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:42.212427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:42.219351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:42.219800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:42.220592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:42.221020 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:42.371115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:42.379771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6000a3eb-22c0-412a-a5b8-508743960f37 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.171620 Jan 19 01:03:42.380363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 428/810] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:42 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:43.396049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:43.396801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:43.403303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:43.403909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:43.404778 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:43.405852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:43.634927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:43.643807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e7d1c7ab-6541-4da9-914b-2725a0e95e8b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.251337 Jan 19 01:03:43.644697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 383/811] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:43 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:44.663113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:44.665203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:44.675122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:44.675577 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:44.676417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:44.676858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:44.848182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:44.859505 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-67ba3e52-15c7-4a8c-a4d2-da00e3a1705c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.200610 Jan 19 01:03:44.860104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 429/812] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:44 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:45.881434 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:45.882099 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:45.889224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:45.889705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:45.890509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:45.890945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:46.060950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:46.069718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1e853954-3bf3-4f97-831a-f2da9f387be6 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.192034 Jan 19 01:03:46.070311 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 384/813] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:45 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:47.089540 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:47.090164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:47.096424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:47.096872 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:47.097755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:47.098188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:47.245860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:47.254716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-07918522-f96c-46ed-a539-cd310ec5b588 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.168705 Jan 19 01:03:47.255334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 430/814] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:47 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:48.271803 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:48.272422 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:48.278804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:48.279263 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:48.280466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:48.280915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:48.436226 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:48.445037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f966dfc0-a331-48ea-b4d5-aae9922b9010 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.176803 Jan 19 01:03:48.445762 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 385/815] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:48 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:49.462295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:49.462944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:49.469642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:49.470100 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:49.470899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:49.471344 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:49.784730 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:49.792458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-37e0e57e-7fde-44f7-a9dc-c6b9d106e4fd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.333976 Jan 19 01:03:49.793024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 431/816] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:49 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:50.810517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:50.811661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:50.817817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:50.818271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:50.819069 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:50.819513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:50.976079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:50.985134 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3226b74a-161b-4058-8261-dbba6eee5485 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.178455 Jan 19 01:03:50.985755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 386/817] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:50 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:52.003064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:52.003604 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:52.009997 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:52.010448 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:52.011243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:52.011685 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:52.151965 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:52.165030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6859caad-0d6a-4b63-863c-19a59457adfe tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.166462 Jan 19 01:03:52.165647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 432/818] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:51 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:53.184364 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:53.185014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:53.191479 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:53.191933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:53.192710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:53.193148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:53.388333 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:53.396699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a8218879-095e-4c97-8e44-402f4f6fe367 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.215951 Jan 19 01:03:53.397278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 387/819] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:53 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:54.414323 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:54.414944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:54.421889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:54.422345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:54.423145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:54.423591 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:54.571274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:54.579746 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4b4942bb-766e-44bf-b71f-8a6994b6a738 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.169009 Jan 19 01:03:54.580341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 433/820] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:54 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:55.597131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:55.597699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:55.603939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:55.604395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:55.605194 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:55.605652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:55.762339 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:55.770091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-284829c6-4488-4d4b-9bbc-de1a83bb218c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.176751 Jan 19 01:03:55.770654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 388/821] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:55 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:56.786828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:56.787446 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:56.793892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:56.794369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:56.795167 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:56.795612 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:56.944913 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:56.952598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-342a70d0-3ba1-45a4-984a-1cc208809acd tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.169455 Jan 19 01:03:56.953161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 434/822] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:56 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:57.970302 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:57.970829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:57.977289 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:57.977773 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:57.978829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:57.979269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:58.131605 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:58.139797 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-79473477-51e5-4e1a-bb1a-cbb1db33c411 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1756 microversion: 2.1 time: 0.173253 Jan 19 01:03:58.140380 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 389/823] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:57 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:03:58.730428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:58.731073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:58.738091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:58.738551 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:58.739373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:58.739807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:58.846194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lazy-loading 'services' on Instance uuid c9b3f56b-4925-42cd-a1c6-11e90d67ebdd {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:03:58.963672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8f3062ff-ebe8-4480-ad7a-daa6419aa94f tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd/os-volume_attachments/cd77fd4b-6960-4efc-8525-6c8afc23f715" status: 202 len: 0 microversion: 2.1 time: 0.237041 Jan 19 01:03:58.964539 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 435/824] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:03:58 2022] DELETE /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd/os-volume_attachments/cd77fd4b-6960-4efc-8525-6c8afc23f715 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:03:59.157395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:03:59.158141 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:03:59.166678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:59.167131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:59.167930 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:03:59.168572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:03:59.329102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:03:59.338483 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4ed326d1-4f79-488c-baf3-69f328e63f4d tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1759 microversion: 2.1 time: 0.185391 Jan 19 01:03:59.339065 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 390/825] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:03:59 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:01.576098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:04:01.576893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:04:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:04:03.272213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:03.273500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:03.296991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:03.297449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:03.301346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:03.303095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:03.342585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:04:03.443649 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-49fc6119-b9ce-4465-8e3d-e930b32eddc3 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 204 len: 0 microversion: 2.1 time: 0.188221 Jan 19 01:04:03.444534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 436/826] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:04:03 2022] DELETE /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:04:03.458701 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:03.459456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:03.467902 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:03.468373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:03.469184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:03.469642 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:03.615454 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:03.623148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-06562fc1-5ba7-4218-bd1f-3c1686309122 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1513 microversion: 2.1 time: 0.172491 Jan 19 01:04:03.623745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 391/827] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:03 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:04.641888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:04.642900 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:04.649817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:04.650277 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:04.651084 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:04.651523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:04.808107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:04.817098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bdd44171-4c9d-4416-9cfd-f9a42617d621 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1513 microversion: 2.1 time: 0.179919 Jan 19 01:04:04.818012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 437/828] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:04 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:05.834082 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:05.834639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:05.841175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:05.841644 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:05.842439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:05.842932 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:05.983527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:05.991248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8e12b050-f28f-4f98-9978-8e312b2959d1 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1513 microversion: 2.1 time: 0.160804 Jan 19 01:04:05.991846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 392/829] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:05 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:07.008815 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:07.009383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:07.016706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:07.017200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:07.018034 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:07.018478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:07.154295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:07.161768 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f81beb69-e052-4fc8-b60b-a36ccab479da tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1513 microversion: 2.1 time: 0.156613 Jan 19 01:04:07.162347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 438/830] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:07 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:08.178524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:08.179140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:08.185468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:08.185961 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:08.186772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:08.187218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:08.390029 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:08.397825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-39a48509-637c-4888-9bca-87b5b6ff0c36 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1513 microversion: 2.1 time: 0.223149 Jan 19 01:04:08.398412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 393/831] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:08 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:08.730100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:04:08.730303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:04:08.981316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ca44ba83-d1f7-40bd-bc95-1939a65be6b4 req-fc499b48-2ebf-49a9-8b21-796966b31e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b3f56b-4925-42cd-a1c6-11e90d67ebdd", "name": "network-vif-deleted", "tag": "955ca13d-bb47-49ba-964d-470483a9019e"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:08.983946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:08.983946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:04:08.992094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ca44ba83-d1f7-40bd-bc95-1939a65be6b4 req-fc499b48-2ebf-49a9-8b21-796966b31e23 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:08.992755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ca44ba83-d1f7-40bd-bc95-1939a65be6b4 req-fc499b48-2ebf-49a9-8b21-796966b31e23 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:09.005075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ca44ba83-d1f7-40bd-bc95-1939a65be6b4 req-fc499b48-2ebf-49a9-8b21-796966b31e23 service nova] Creating event network-vif-deleted:955ca13d-bb47-49ba-964d-470483a9019e for instance c9b3f56b-4925-42cd-a1c6-11e90d67ebdd on hv-cinder-79987 Jan 19 01:04:09.011668 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ca44ba83-d1f7-40bd-bc95-1939a65be6b4 req-fc499b48-2ebf-49a9-8b21-796966b31e23 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 Jan 19 01:04:09.012985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 439/832] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:09.416391 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:09.416995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:09.423459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:09.423898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:09.424915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:09.425351 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:09.455265 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:09.455710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:09.456160 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lazy-loading 'fault' on Instance uuid c9b3f56b-4925-42cd-a1c6-11e90d67ebdd {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:04:09.495976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52500125c44ab5a9ffdb801248f33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac73f1c040f94f43bcdd01f92771821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:09.504014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0e3b1de6-46b1-4766-989b-47b39f0c4882 tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 200 len: 1308 microversion: 2.1 time: 0.091711 Jan 19 01:04:09.504691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 394/833] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:09 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:10.522108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:10.522937 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] [instance: c9b3f56b-4925-42cd-a1c6-11e90d67ebdd] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:10.531113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:10.531841 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:10.532758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:10.533282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:10.556122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] HTTP exception thrown: Instance c9b3f56b-4925-42cd-a1c6-11e90d67ebdd could not be found. Jan 19 01:04:10.556830 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] Returning 404 to user: Instance c9b3f56b-4925-42cd-a1c6-11e90d67ebdd could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:04:10.557716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-04f997e9-90f9-45c0-92d0-60a9fd28f48b tempest-VolumesSnapshotTestJSON-1601643320 tempest-VolumesSnapshotTestJSON-1601643320-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd" status: 404 len: 111 microversion: 2.1 time: 0.039948 Jan 19 01:04:10.558291 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 440/834] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:10 2022] GET /compute/v2.1/servers/c9b3f56b-4925-42cd-a1c6-11e90d67ebdd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:04:11.782575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:04:11.783173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:04:16.457815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:16.458312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:16.464495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.464853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.465786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.466221 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.506354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6bbcb240-d0b6-4aef-b407-a941e0c27526 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments/48baeb7d-6f4b-4dfa-b135-cdaa4a6c2fa0" status: 200 len: 194 microversion: 2.20 time: 0.216263 Jan 19 01:04:16.506960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 395/835] 10.222.0.35 () {60 vars in 1453 bytes} [Wed Jan 19 01:04:16 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments/48baeb7d-6f4b-4dfa-b135-cdaa4a6c2fa0 => generated 194 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:16.578300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:16.578833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:16.585026 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.585488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.586326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.586773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.668066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lazy-loading 'services' on Instance uuid fdb95a1c-6e71-42df-9009-f72ff6c3b21b {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:04:16.737960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-761d39fc-246e-4027-b885-3f597c60a74f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments/48baeb7d-6f4b-4dfa-b135-cdaa4a6c2fa0" status: 202 len: 0 microversion: 2.20 time: 0.164623 Jan 19 01:04:16.739052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 441/836] 10.222.0.35 () {60 vars in 1456 bytes} [Wed Jan 19 01:04:16 2022] DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments/48baeb7d-6f4b-4dfa-b135-cdaa4a6c2fa0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:04:16.747711 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:16.749281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:16.756321 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.756791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.757635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:16.758136 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:16.788418 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7a45f1ab-4aca-40e4-b00e-57ecb3577542 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044809 Jan 19 01:04:16.788990 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 396/837] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:16 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:17.800927 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:17.802010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:17.812666 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:17.813124 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:17.814015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:17.814413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:17.847709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-553a496e-1663-494f-b653-3eaa00325155 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051203 Jan 19 01:04:17.848275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 442/838] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:17 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:18.862127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:18.863562 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:18.870733 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:18.871233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:18.871929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:18.872369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:18.906423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-59109473-e0dc-4a92-91c9-a36febe16bfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048955 Jan 19 01:04:18.907000 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 397/839] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:18 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:19.918273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:19.919199 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:19.925881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:19.926339 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:19.927152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:19.927599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:19.957436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-59d93a1e-7299-474d-9ea8-33cbfde24d77 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Jan 19 01:04:19.958058 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 443/840] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:19 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:20.970119 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:20.971040 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:20.977677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:20.978130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:20.978924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:20.979356 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:21.009723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7aa7e08e-e2b2-4be3-8bcc-1e8a0186418a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Jan 19 01:04:21.010324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 398/841] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:20 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:22.021867 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:22.022698 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:22.029882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:22.030856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:22.031676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:22.032123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:22.064882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-290a478b-c151-4255-b6b8-5cbfd531b199 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046974 Jan 19 01:04:22.065463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 444/842] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:22 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:23.076556 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:23.077634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:23.083771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.084224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.085013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.085459 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.123989 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1044ed65-0976-4537-870d-96ebc8b916ff tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051312 Jan 19 01:04:23.124603 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 399/843] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:04:23 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:23.181318 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:23.181896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:23.188419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.188879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.189760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.190152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.220299 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:04:23.302462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-df9277ad-f4e4-427b-b342-75aa949e75aa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 204 len: 0 microversion: 2.20 time: 0.124295 Jan 19 01:04:23.303864 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 445/844] 10.222.0.35 () {60 vars in 1279 bytes} [Wed Jan 19 01:04:23 2022] DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 01:04:23.312103 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:23.312729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:23.318918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.319371 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.320151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.320586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:23.466866 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:23.476143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:23.477693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:23.478868 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-76d6e182-4d83-4360-a971-6a09a8bf1dd3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.170754 Jan 19 01:04:23.479435 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 400/845] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:23 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:04:23.991818 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:23.992863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:23.998915 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:23.999942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.000759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.001209 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.063439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b15f2131-ec04-473b-bf64-8d3c63462f6c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075235 Jan 19 01:04:24.064111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 446/846] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:04:23 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:24.126476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:24.127598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:24.134237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.134690 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.135503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.135942 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.179376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:04:24.293382 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-df1b7772-6e5d-49bb-86d6-8bf67b80759e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 204 len: 0 microversion: 2.1 time: 0.170030 Jan 19 01:04:24.294100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 401/847] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:04:24 2022] DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:04:24.303847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:24.304859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:24.313197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.314129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.315434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.316523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.500067 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:24.500670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:24.506929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.507383 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.508184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:24.508621 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:24.514391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:24.523868 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-db68ed1b-a212-4cb0-9251-7d18e328f780 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1669 microversion: 2.1 time: 0.224436 Jan 19 01:04:24.525123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 447/848] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:24 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:24.679406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:24.688267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:24.689854 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:24.691078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a772128c-9522-4edf-b05f-dfc008879312 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.196183 Jan 19 01:04:24.691651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 402/849] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:24 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:25.544874 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:25.547571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:25.576431 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:25.578102 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:25.581388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:25.582477 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:25.709720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:25.710456 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:25.725155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:25.729973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:25.731379 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:25.732452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:25.848396 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:25.861154 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-db3b6854-acce-45f1-aa3d-0804404e3ae2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1669 microversion: 2.1 time: 0.321806 Jan 19 01:04:25.862584 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 448/850] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:25 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1669 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:25.992722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:26.002472 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:26.004365 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:26.005708 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4b04e639-27c4-429f-a974-4b7ca3415f0a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1724 microversion: 2.20 time: 0.300052 Jan 19 01:04:26.006683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 403/851] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:25 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:04:26.885295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:26.886743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:26.907813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:26.909303 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:26.912137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:26.912590 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:27.197704 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:27.211037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3e580675-eb7b-43c7-81f1-b5a91842fc5e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1669 microversion: 2.1 time: 0.333190 Jan 19 01:04:27.212228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 449/852] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:26 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1669 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:27.224946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:27.225776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:27.232346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:27.233058 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:27.234750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:27.235400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:27.290807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-9b00644b-8bc1-4fcf-9a26-5d8679b9e2b7 req-0dd43405-2b01-442f-a8ac-cebfb59a95aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb95a1c-6e71-42df-9009-f72ff6c3b21b", "name": "network-vif-deleted", "tag": "106fe9e6-c59d-4f8e-a0e4-1767d393e612"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:27.293840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:27.293840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:27.302165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-9b00644b-8bc1-4fcf-9a26-5d8679b9e2b7 req-0dd43405-2b01-442f-a8ac-cebfb59a95aa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:27.302847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-9b00644b-8bc1-4fcf-9a26-5d8679b9e2b7 req-0dd43405-2b01-442f-a8ac-cebfb59a95aa service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:27.312739 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:27.319649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-9b00644b-8bc1-4fcf-9a26-5d8679b9e2b7 req-0dd43405-2b01-442f-a8ac-cebfb59a95aa service nova] Creating event network-vif-deleted:106fe9e6-c59d-4f8e-a0e4-1767d393e612 for instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b on hv-cinder-79987 Jan 19 01:04:27.325096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-9b00644b-8bc1-4fcf-9a26-5d8679b9e2b7 req-0dd43405-2b01-442f-a8ac-cebfb59a95aa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365397 Jan 19 01:04:27.325976 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 404/853] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:27.329943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:27.331742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:27.332966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6abe717f-653a-440d-b0a2-1ef572a58011 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1656 microversion: 2.20 time: 0.116960 Jan 19 01:04:27.334252 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 450/854] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:27 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1656 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:28.229686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:28.230407 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:28.237743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:28.238193 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:28.239061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:28.239494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:28.352087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:28.352087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:28.364223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:28.365327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:28.367006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:28.367757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:28.413731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:28.423873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2c96992c-4720-420c-81b9-de9ebc62af1e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1669 microversion: 2.1 time: 0.199006 Jan 19 01:04:28.424843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 405/855] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:28 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:28.455445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:28.464545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:28.466086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:28.467288 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d4deacaa-157d-4bef-8bc8-e9234079bb87 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1656 microversion: 2.20 time: 0.119695 Jan 19 01:04:28.468450 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 451/856] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:28 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1656 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:04:29.442465 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:29.443028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:29.449335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:29.449826 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:29.450595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:29.451030 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:29.487597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:29.488223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:29.496179 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:29.496638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:29.497460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:29.497923 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:29.535413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:29.536119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:29.536738 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lazy-loading 'fault' on Instance uuid fdb95a1c-6e71-42df-9009-f72ff6c3b21b {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:04:29.584819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:29.599426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:29.601132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:29.602378 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-055bc64a-86ab-4ceb-bd8b-5079bdf0e928 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 200 len: 1371 microversion: 2.20 time: 0.119624 Jan 19 01:04:29.603462 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 452/857] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:29 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:29.724469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:29.733806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ed6d844b-406d-42dd-bad7-851690f7deb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1669 microversion: 2.1 time: 0.295007 Jan 19 01:04:29.735586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 406/858] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:29 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:30.642892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:30.645008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:30.654606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:30.656094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:30.659205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:30.660117 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:30.678938 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. Jan 19 01:04:30.679917 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:04:30.680897 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f92219af-ffd4-44bf-8e47-d0753a424572 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 404 len: 111 microversion: 2.20 time: 0.049095 Jan 19 01:04:30.681883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 453/859] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:30 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:04:30.690402 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-69edda2c-9660-43aa-b741-431efceba2f1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '.version_select at 0x7f934c6eb3a0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:30.730189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-69edda2c-9660-43aa-b741-431efceba2f1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142668122" status: 204 len: 0 microversion: 2.20 time: 0.043281 Jan 19 01:04:30.731269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 407/860] 10.222.0.35 () {60 vars in 1261 bytes} [Wed Jan 19 01:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142668122 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 01:04:30.755014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:30.756050 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:30.771606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:30.771995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:30.775113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:30.775580 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:30.862032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:30.871496 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-7d929dd5-7d31-4b45-8d31-83bc187b611a req-2fe566e2-7bc4-4f6b-86aa-ddc763b27f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e94f1-dc77-4535-8a26-e8ff5d3e7f54", "name": "network-vif-deleted", "tag": "83a2ace7-080c-4dd2-88ad-7ee6cdf7db21"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:30.877859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:30.877859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:30.886138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-13b5bf70-1bf8-486e-ac54-458e73965d8d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 200 len: 1601 microversion: 2.1 time: 0.137516 Jan 19 01:04:30.887805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 454/861] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:30 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 1601 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:30.900665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-7d929dd5-7d31-4b45-8d31-83bc187b611a req-2fe566e2-7bc4-4f6b-86aa-ddc763b27f5a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:30.901401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-7d929dd5-7d31-4b45-8d31-83bc187b611a req-2fe566e2-7bc4-4f6b-86aa-ddc763b27f5a service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:30.926357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-7d929dd5-7d31-4b45-8d31-83bc187b611a req-2fe566e2-7bc4-4f6b-86aa-ddc763b27f5a service nova] Creating event network-vif-deleted:83a2ace7-080c-4dd2-88ad-7ee6cdf7db21 for instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 on hv-cinder-79987 Jan 19 01:04:30.933885 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-7d929dd5-7d31-4b45-8d31-83bc187b611a req-2fe566e2-7bc4-4f6b-86aa-ddc763b27f5a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070188 Jan 19 01:04:30.934408 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 408/862] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:04:31.809578 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: .version_select at 0x7f934c6ac040>, body: {"keypair": {"name": "tempest-keypair-577432436"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:31.823977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:31.829118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:31.906838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:31.907683 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:31.914334 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:31.914907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:31.915821 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:31.916531 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:31.931572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. Jan 19 01:04:31.932170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:04:31.933198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-55056a52-164d-4a13-8903-c115246ca944 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 404 len: 111 microversion: 2.1 time: 0.031338 Jan 19 01:04:31.938014 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 409/863] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:31 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:04:31.942845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7a652bc7-dae4-4796-a5b9-c06d5c4d1ec2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '.version_select at 0x7f934c622ee0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:31.972166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7a652bc7-dae4-4796-a5b9-c06d5c4d1ec2 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89690333" status: 202 len: 0 microversion: 2.1 time: 0.032602 Jan 19 01:04:31.972927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 410/864] 10.222.0.35 () {58 vars in 1214 bytes} [Wed Jan 19 01:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89690333 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:04:31.985436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:31.991619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:32.008887 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1643b989-2710-4ffc-aead-4d11328fdd4d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.203100 Jan 19 01:04:32.009512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 455/865] 10.222.0.35 () {62 vars in 1198 bytes} [Wed Jan 19 01:04:31 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 01:04:33.273545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: .version_select at 0x7f934c653820>, body: {"keypair": {"name": "tempest-keypair-1087073868"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:33.288605 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:33.292372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:33.480409 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:33.486031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'key_pairs'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:33.499117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4f5129d8-ecdb-478c-b50a-1f0a13702506 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.229835 Jan 19 01:04:33.499812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 411/866] 10.222.0.35 () {60 vars in 1157 bytes} [Wed Jan 19 01:04:33 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:33.978496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1215368613", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10a2bcb-9525-4cb7-b8dd-683cdf95f329"}], "security_groups": [{"name": "tempest-securitygroup--654572259"}], "key_name": "tempest-keypair-577432436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:34.113592 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] validate_networks() for [('d10a2bcb-9525-4cb7-b8dd-683cdf95f329', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:04:34.657500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:04:34.657966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:04:34.658436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:04:34.658898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:04:34.659327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:04:34.669173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:34.669657 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:34.671211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:34.671655 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:34.689400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for project 26e726f093b7418db87497cfb659dbf3. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:34.694118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Getting quotas for user 1fa32be6bac74509963e42686fbab16c and project 26e726f093b7418db87497cfb659dbf3. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:34.707327 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:04:34.709708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:04:34.759358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-56dfc498-a99c-4f61-863e-b5a0f66cbb9a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.785650 Jan 19 01:04:34.761363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 456/867] 10.222.0.35 () {62 vars in 1187 bytes} [Wed Jan 19 01:04:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 01:04:34.769996 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:34.770603 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:34.833321 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:34.848387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:34.850419 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:34.851775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d2624fc3-3cae-4b8d-9b9a-a22169c96856 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1281 microversion: 2.20 time: 0.085500 Jan 19 01:04:34.852529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 412/868] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:34 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:35.130632 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-661337718", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a69b36d3-e9c7-4bd1-806e-4931e3175337"}], "security_groups": [{"name": "tempest-securitygroup--1401462366"}], "key_name": "tempest-keypair-1087073868", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:35.250969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] validate_networks() for [('a69b36d3-e9c7-4bd1-806e-4931e3175337', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:04:35.719790 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:04:35.720230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:04:35.720721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:04:35.721137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:04:35.721577 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:04:35.729878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:35.730343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:35.731170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:35.731620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:35.747468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for project ef284d2a245247f7a8561985ecb39098. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:04:35.751794 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Getting quotas for user 9cb01d5ca22b42bf9c4b07c5d5dc32ef and project ef284d2a245247f7a8561985ecb39098. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:04:35.765423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:04:35.767644 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:04:35.816587 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a787fca2-92d3-4468-94cc-cb7d8a1a0c7a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690105 Jan 19 01:04:35.817230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 457/869] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:04:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 01:04:35.827822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-582de468-da74-4740-b32c-c99523ca22ed tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:35.829071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-582de468-da74-4740-b32c-c99523ca22ed tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:35.870797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:35.871410 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:35.879409 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:35.879963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:35.880898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:35.881546 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:35.885031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-582de468-da74-4740-b32c-c99523ca22ed tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:35.896943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-582de468-da74-4740-b32c-c99523ca22ed tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1237 microversion: 2.1 time: 0.072973 Jan 19 01:04:35.898131 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 413/870] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:35 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:35.952651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:35.960843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:35.962429 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:35.963567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8861bd10-a1f1-484e-ab07-8322db8decfa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1333 microversion: 2.20 time: 0.096833 Jan 19 01:04:35.964121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 458/871] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:35 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:04:36.921314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:36.923022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:36.934705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:36.935468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:36.936955 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:36.937596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:36.983939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:36.985210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:37.003860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:37.004589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:37.005828 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:37.006724 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:37.069462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:37.084731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-269660ea-40c1-40ac-98ae-8a0ae9bf5603 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1297 microversion: 2.1 time: 0.169472 Jan 19 01:04:37.097299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 414/872] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:36 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1297 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:37.328808 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:37.337832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:37.339357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:37.345890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2082afdb-0e4c-4f79-9847-17cdc2a1d7ab tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.366441 Jan 19 01:04:37.346487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 459/873] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:36 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:37.996687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-578f1bf2-a572-4cab-a543-ccf0065a4f38 req-a851c2be-8e91-45f1-b138-3baab7f71953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:38.000545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:38.000545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:38.018305 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-578f1bf2-a572-4cab-a543-ccf0065a4f38 req-a851c2be-8e91-45f1-b138-3baab7f71953 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:38.019574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-578f1bf2-a572-4cab-a543-ccf0065a4f38 req-a851c2be-8e91-45f1-b138-3baab7f71953 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:38.069226 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-578f1bf2-a572-4cab-a543-ccf0065a4f38 req-a851c2be-8e91-45f1-b138-3baab7f71953 service nova] Creating event network-changed:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:04:38.100227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-578f1bf2-a572-4cab-a543-ccf0065a4f38 req-a851c2be-8e91-45f1-b138-3baab7f71953 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112893 Jan 19 01:04:38.100957 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 415/874] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:38.106006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:38.108637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:38.119028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:38.119759 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:38.121772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:38.124810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:38.371617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:38.372338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:38.379704 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:38.380417 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:38.381529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:38.382094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:38.424164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:38.442139 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fec8c76c-2ff9-4f95-b4a0-71562c2d725b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.337201 Jan 19 01:04:38.443091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 460/875] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:38 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:38.693771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:38.703242 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:38.705395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:38.706634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f63e5f80-96c2-4f60-bbdf-17cdd43b771f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.342522 Jan 19 01:04:38.717041 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 416/876] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:38 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:04:39.139992 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-623e12e2-e2f1-4de8-a11d-47b7cc807b9a req-99590099-335f-4bf8-b82b-365ab1a977fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afcb7dd-d512-4061-a2da-c747612ed110", "tag": "381ef2e4-65b1-47b4-af5a-b60f3d5edee6"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:39.142663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:39.142663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:04:39.150265 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-623e12e2-e2f1-4de8-a11d-47b7cc807b9a req-99590099-335f-4bf8-b82b-365ab1a977fd service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:39.150721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-623e12e2-e2f1-4de8-a11d-47b7cc807b9a req-99590099-335f-4bf8-b82b-365ab1a977fd service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:39.164432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-623e12e2-e2f1-4de8-a11d-47b7cc807b9a req-99590099-335f-4bf8-b82b-365ab1a977fd service nova] Creating event network-changed:381ef2e4-65b1-47b4-af5a-b60f3d5edee6 for instance 3afcb7dd-d512-4061-a2da-c747612ed110 on hv-cinder-79987 Jan 19 01:04:39.171152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-623e12e2-e2f1-4de8-a11d-47b7cc807b9a req-99590099-335f-4bf8-b82b-365ab1a977fd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131433 Jan 19 01:04:39.171779 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 461/877] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:39.459685 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:39.460289 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:39.466841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:39.468042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:39.469002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:39.469444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:39.620732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:39.628332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2d197a53-f7eb-473d-9abc-79c87d449288 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.172347 Jan 19 01:04:39.628933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 417/878] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:39 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:39.729635 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:39.731473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:39.742765 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:39.743687 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:39.745311 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:39.746247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:40.240891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:40.252414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:40.254300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:40.255447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a5be36e1-fbbc-434f-8341-589c33ebd6bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.533881 Jan 19 01:04:40.266825 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 462/879] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:39 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:40.645685 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:40.646295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:40.652671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:40.653120 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:40.653919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:40.654353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:40.804823 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:40.812664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c9fe4a88-6780-4ea6-a690-95c57e7675f7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.170396 Jan 19 01:04:40.813703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 418/880] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:40 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:41.274354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:41.275071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:41.281984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:41.282370 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:41.283171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:41.283605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:41.413845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:41.424287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:41.427180 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:41.428309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-681a8080-211b-4f80-90a9-f19aa3b53e06 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.157724 Jan 19 01:04:41.428872 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 463/881] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:41 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:41.829775 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:41.830410 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:41.836672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:41.837127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:41.837952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:41.838392 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:41.971590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:41.978760 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cbecabf7-f5aa-4748-9942-9aeefd2bb08d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.153269 Jan 19 01:04:41.979320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 419/882] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:41 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:42.450060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:42.451239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:42.462413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:42.463243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:42.464747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:42.465688 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:42.623099 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:42.631791 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:42.633325 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:42.634483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3b63be0b-dc17-43d8-9722-f96dea8dbc50 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.191327 Jan 19 01:04:42.635063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 464/883] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:42 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:42.996295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:42.997909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:43.005152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:43.005867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:43.006788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:43.007535 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:43.147270 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:43.154578 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2b473f97-6540-4e52-8e57-16ddab6d7396 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.162286 Jan 19 01:04:43.155694 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 420/884] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:42 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:43.653213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:43.653860 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:43.660710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:43.661168 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:43.662029 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:43.662477 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:43.805531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:43.814149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:43.815642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:43.816745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cd04e07e-0fa4-4a29-a5a0-fa8c1bf3a436 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.167430 Jan 19 01:04:43.817307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 465/885] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:43 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:44.172733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:44.173833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:44.180269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:44.180948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:44.182115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:44.183128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:44.308396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-6b325439-f39f-4da6-9d99-fe0ea9e5ec48 req-867d8adf-27dc-4b07-b91a-46151b75b16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "name": "network-vif-plugged", "status": "completed", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:44.310340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:44.310340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:44.317867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-6b325439-f39f-4da6-9d99-fe0ea9e5ec48 req-867d8adf-27dc-4b07-b91a-46151b75b16b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:44.318322 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-6b325439-f39f-4da6-9d99-fe0ea9e5ec48 req-867d8adf-27dc-4b07-b91a-46151b75b16b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:44.330551 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-6b325439-f39f-4da6-9d99-fe0ea9e5ec48 req-867d8adf-27dc-4b07-b91a-46151b75b16b service nova] Creating event network-vif-plugged:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:04:44.335639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-6b325439-f39f-4da6-9d99-fe0ea9e5ec48 req-867d8adf-27dc-4b07-b91a-46151b75b16b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244692 Jan 19 01:04:44.336243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 421/886] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:44.353273 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:44.363646 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2a8cda31-f333-478f-b7f4-938720c0ecdb tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.195095 Jan 19 01:04:44.364243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 466/887] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:44 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:44.836049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:44.836656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:44.843058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:44.843536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:44.844322 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:44.844751 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:44.979674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:44.988182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:44.989719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:44.990833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-cd8341d0-9427-4386-9e1e-f247b35bc90e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1406 microversion: 2.20 time: 0.159090 Jan 19 01:04:44.991400 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 422/888] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:44 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:45.380540 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:45.381151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:45.387623 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:45.388099 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:45.388890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:45.389914 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:45.528891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:45.536298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6541c6b0-49a1-47f3-bee5-9b25a8c691c6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.159366 Jan 19 01:04:45.536901 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 467/889] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:45 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:46.009601 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:46.010390 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:46.016758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.017211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.018049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.018485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.183130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:46.191137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:46.192686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:46.193950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d8298e39-523e-4178-8372-fa846614c1b2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1599 microversion: 2.20 time: 0.188344 Jan 19 01:04:46.194517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 423/890] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:04:46 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:04:46.211260 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:46.211781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:46.218150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.218598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.219582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.220021 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.315690 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2fcea4a3-a1ac-4129-b452-633a9057d638 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108134 Jan 19 01:04:46.316480 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 468/891] 10.222.0.35 () {60 vars in 1315 bytes} [Wed Jan 19 01:04:46 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:04:46.351699 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-5e2e02cf-8b79-4048-b58c-ce7b8a307a84 req-3b994c4c-2e4a-4df5-9bb8-a7e1ed3e87d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afcb7dd-d512-4061-a2da-c747612ed110", "name": "network-vif-plugged", "status": "completed", "tag": "381ef2e4-65b1-47b4-af5a-b60f3d5edee6"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:46.353581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:46.353581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:46.365377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-5e2e02cf-8b79-4048-b58c-ce7b8a307a84 req-3b994c4c-2e4a-4df5-9bb8-a7e1ed3e87d6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.365856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-5e2e02cf-8b79-4048-b58c-ce7b8a307a84 req-3b994c4c-2e4a-4df5-9bb8-a7e1ed3e87d6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.377972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-5e2e02cf-8b79-4048-b58c-ce7b8a307a84 req-3b994c4c-2e4a-4df5-9bb8-a7e1ed3e87d6 service nova] Creating event network-vif-plugged:381ef2e4-65b1-47b4-af5a-b60f3d5edee6 for instance 3afcb7dd-d512-4061-a2da-c747612ed110 on hv-cinder-79987 Jan 19 01:04:46.383186 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-5e2e02cf-8b79-4048-b58c-ce7b8a307a84 req-3b994c4c-2e4a-4df5-9bb8-a7e1ed3e87d6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034924 Jan 19 01:04:46.384106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 424/892] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:04:46.554234 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:46.555504 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:46.561883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.562442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.563210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:46.563663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:46.924893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:46.932106 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-921f010e-fb58-4223-9c18-6a1a5fc3b1aa tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.382543 Jan 19 01:04:46.932684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 469/893] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:46 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:47.487635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:47.488663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:47.496797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-0d8b4248-fe98-4480-ad2f-f24501a0dc7f req-ea0c10e7-613d-4d63-8840-962be18a8e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:47.498622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:47.498622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:04:47.503512 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:47.504388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:47.505766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:47.505894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0d8b4248-fe98-4480-ad2f-f24501a0dc7f req-ea0c10e7-613d-4d63-8840-962be18a8e92 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:47.506269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0d8b4248-fe98-4480-ad2f-f24501a0dc7f req-ea0c10e7-613d-4d63-8840-962be18a8e92 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:47.506493 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:47.520235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-0d8b4248-fe98-4480-ad2f-f24501a0dc7f req-ea0c10e7-613d-4d63-8840-962be18a8e92 service nova] Creating event network-changed:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:04:47.526459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-0d8b4248-fe98-4480-ad2f-f24501a0dc7f req-ea0c10e7-613d-4d63-8840-962be18a8e92 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Jan 19 01:04:47.527680 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 470/894] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:47.623166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-75aa7fb3-62fa-456a-bdc5-7111cbba3105 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.139602 Jan 19 01:04:47.625003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 425/895] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:47 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:47.949872 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:47.950744 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:47.960419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:47.961189 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:47.962418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:47.963126 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:48.250268 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:48.262619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4c835420-dfba-4d52-9df4-dc3efdf692df tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1363 microversion: 2.1 time: 0.316592 Jan 19 01:04:48.263513 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 471/896] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:47 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:48.635353 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:48.636598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:48.644347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:48.644691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:48.645821 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:48.646484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:48.741884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c233e2d6-65a6-48d7-942b-b6eb389a6aec tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.110360 Jan 19 01:04:48.745081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 426/897] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:48 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:49.255419 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2019152140"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:49.256129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:49.262400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.263403 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.264588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.265258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.287378 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:49.288384 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:49.295798 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.296251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.297333 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.297917 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.440995 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.network.security_group_api [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Removing security group b299d5c3-3091-4714-8992-7998dee44112 from port 9758b8ed-8939-4a51-8bec-bc88b27b6d7d Jan 19 01:04:49.484172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:49.501142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-43fb418f-9c00-4973-a153-e46ad8d0da0d tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1549 microversion: 2.1 time: 0.217290 Jan 19 01:04:49.502273 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 427/898] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:49 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:49.519472 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:49.520138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:49.526523 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.526865 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.527889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.528490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.637337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-469cfb37-c43f-4c0b-adad-501261f14fb5 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121634 Jan 19 01:04:49.638331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 428/899] 10.222.0.35 () {58 vars in 1274 bytes} [Wed Jan 19 01:04:49 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:04:49.756952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:49.758139 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:49.766693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.767804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.769711 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.770281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.868340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6622947c-6388-4a3c-a6d9-a06d644fcbd9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.119295 Jan 19 01:04:49.872672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 429/900] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:49 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:49.914389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7180a254-66b6-49e9-ada6-e5bbaedd82a5 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action" status: 202 len: 0 microversion: 2.1 time: 0.662399 Jan 19 01:04:49.914845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 472/901] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:49 2022] POST /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:04:49.932205 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-12a9dd26-69bd-4085-b2ea-bc6707507c76 req-5d4a401a-c81e-4898-aac1-d9e93faa795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:49.940846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:49.940846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:49.958338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-12a9dd26-69bd-4085-b2ea-bc6707507c76 req-5d4a401a-c81e-4898-aac1-d9e93faa795f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:49.959172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-12a9dd26-69bd-4085-b2ea-bc6707507c76 req-5d4a401a-c81e-4898-aac1-d9e93faa795f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:49.973517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-12a9dd26-69bd-4085-b2ea-bc6707507c76 req-5d4a401a-c81e-4898-aac1-d9e93faa795f service nova] Creating event network-changed:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:04:49.980711 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-12a9dd26-69bd-4085-b2ea-bc6707507c76 req-5d4a401a-c81e-4898-aac1-d9e93faa795f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057114 Jan 19 01:04:49.982216 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 430/902] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:50.881499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:50.883514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:50.892166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:50.892985 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:50.894338 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:50.895039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:51.002737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a1c2ce93-b3bb-4cc6-a3a0-7ad7a72e2cac tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.125063 Jan 19 01:04:51.003571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 473/903] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:50 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:51.072648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:51.073803 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:51.081183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-ff46790b-2aa8-4735-9f57-7c4c23df7db3 req-79ff3494-b648-4aa6-83f1-a89d2d4c129b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afcb7dd-d512-4061-a2da-c747612ed110", "tag": "381ef2e4-65b1-47b4-af5a-b60f3d5edee6"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:51.083520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:51.084908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:51.084908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:04:51.085104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:51.087111 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:51.087879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:51.095015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ff46790b-2aa8-4735-9f57-7c4c23df7db3 req-79ff3494-b648-4aa6-83f1-a89d2d4c129b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:51.095865 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-ff46790b-2aa8-4735-9f57-7c4c23df7db3 req-79ff3494-b648-4aa6-83f1-a89d2d4c129b service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:51.112474 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-ff46790b-2aa8-4735-9f57-7c4c23df7db3 req-79ff3494-b648-4aa6-83f1-a89d2d4c129b service nova] Creating event network-changed:381ef2e4-65b1-47b4-af5a-b60f3d5edee6 for instance 3afcb7dd-d512-4061-a2da-c747612ed110 on hv-cinder-79987 Jan 19 01:04:51.117878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-ff46790b-2aa8-4735-9f57-7c4c23df7db3 req-79ff3494-b648-4aa6-83f1-a89d2d4c129b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042925 Jan 19 01:04:51.119070 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 474/904] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:04:51.221935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f8eae24a-6822-424d-8d9c-94603ef662a1 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.154986 Jan 19 01:04:51.223320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 431/905] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:51 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:52.020238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:52.021541 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:52.038900 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.039360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.046727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.047545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.052236 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:52.053425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:52.065075 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.065859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.067047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.068148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.156258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-985b1e63-9d89-4098-afed-07ff771a6b40 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.143932 Jan 19 01:04:52.156967 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lazy-loading 'services' on Instance uuid 4a9e8236-4e4c-4513-9f9d-9e734f41c21f {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:04:52.157470 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 475/906] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:52 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:52.235740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:52.237749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:52.245911 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.246802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.247902 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.248622 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.265611 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-867f01a2-e4ee-470b-973f-4bc832c462e0 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments/8764012d-23f0-43ea-ae9d-56c6af74cdca" status: 202 len: 0 microversion: 2.1 time: 0.223746 Jan 19 01:04:52.268606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 432/907] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:04:52 2022] DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments/8764012d-23f0-43ea-ae9d-56c6af74cdca => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:04:52.285436 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:52.287933 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:52.303114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.304344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.306087 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:52.307084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:52.374684 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9fea4eea-5695-4dc9-ac17-a3c1e713660c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098098 Jan 19 01:04:52.375788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 433/908] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:04:52 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:52.377989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-24c6eca8-8982-43da-93b9-59eb75dd91ad tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.148249 Jan 19 01:04:52.379248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 476/909] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:52 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:53.145237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-235ab644-08d0-4bb8-9f25-2a29524f09f1 req-6829be46-fe42-451b-b244-61ddb379c737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:53.146888 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:53.146888 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:04:53.154492 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-235ab644-08d0-4bb8-9f25-2a29524f09f1 req-6829be46-fe42-451b-b244-61ddb379c737 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.155002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-235ab644-08d0-4bb8-9f25-2a29524f09f1 req-6829be46-fe42-451b-b244-61ddb379c737 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.168559 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-235ab644-08d0-4bb8-9f25-2a29524f09f1 req-6829be46-fe42-451b-b244-61ddb379c737 service nova] Creating event network-changed:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:04:53.173720 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:53.176125 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-235ab644-08d0-4bb8-9f25-2a29524f09f1 req-6829be46-fe42-451b-b244-61ddb379c737 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034822 Jan 19 01:04:53.176723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:53.177196 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 434/910] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:53.187270 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.187733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.188564 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.188978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.303862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fa418411-cc48-4b3a-823d-41dabfd738b0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.138947 Jan 19 01:04:53.309970 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 477/911] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:53 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:53.388564 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:53.395228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:53.397202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:53.400989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:53.408010 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.408186 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.408925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.410449 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.411255 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.411745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.412823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.413269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.451900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c1f7de7b-dfb2-4fee-9a98-1d9b780144c2 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067645 Jan 19 01:04:53.452800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 435/912] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:04:53 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 01:04:53.462961 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:53.463574 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:53.470591 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.471126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.471986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:53.472494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:53.510445 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cb915fda-eaaf-4168-91ad-7c27b30ecb1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.119444 Jan 19 01:04:53.512207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 478/913] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:53 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:53.556787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] HTTP exception thrown: Instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f is not attached to volume 8764012d-23f0-43ea-ae9d-56c6af74cdca Jan 19 01:04:53.557398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Returning 404 to user: Instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f is not attached to volume 8764012d-23f0-43ea-ae9d-56c6af74cdca {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:04:53.558280 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-593237c7-b7f9-49b4-957c-46f0211bab3b tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments/8764012d-23f0-43ea-ae9d-56c6af74cdca" status: 404 len: 154 microversion: 2.1 time: 0.099662 Jan 19 01:04:53.559062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 436/914] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:04:53 2022] DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f/os-volume_attachments/8764012d-23f0-43ea-ae9d-56c6af74cdca => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:04:54.317500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:54.318636 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:54.325775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.326261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.327103 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.328091 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.425539 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-de57accc-bd16-47d1-ae5d-2c947b032ab9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.113322 Jan 19 01:04:54.427155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 479/915] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:54 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:54.522889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:54.523760 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:54.532452 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.532907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.533731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.534177 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.636266 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ea2db129-c08e-40ad-b18f-a9beec334e08 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.117014 Jan 19 01:04:54.636908 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 437/916] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:54 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 01:04:54.703727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:54.704356 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:54.711463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.711948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.712762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.713206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.739253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:04:54.817677 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1cd049c4-8dc2-454a-a7c8-7e3562cc5f38 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 204 len: 0 microversion: 2.1 time: 0.117861 Jan 19 01:04:54.818745 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 480/917] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:04:54 2022] DELETE /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:04:54.828635 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:54.829340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:54.839375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.839833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.840653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:54.841089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:54.990691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:54.999609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fec03cd8-011d-4b2d-87e3-79bbd83f16e1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1554 microversion: 2.1 time: 0.174362 Jan 19 01:04:55.000192 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 438/918] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:54 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:55.437129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:55.438179 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:55.447717 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:55.448372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:55.449182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:55.449640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:55.546042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b8737c5b-b136-4d63-b7c4-25145f130479 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.112737 Jan 19 01:04:55.546975 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 481/919] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:55 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:55.647781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:55.648702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:55.656861 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:55.657328 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:55.658187 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:55.658629 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:55.750484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8c85b2c3-e2d8-4bb9-85cd-dbb8499cb21a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.106077 Jan 19 01:04:55.751061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 439/920] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:55 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:56.020681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:56.021315 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:56.028494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.028846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.029787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.030231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.202644 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:56.212512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-14ffc80f-08db-4c38-b413-5177936061ed tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1554 microversion: 2.1 time: 0.198088 Jan 19 01:04:56.213114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 482/921] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:56 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:56.557307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:56.558354 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:56.565144 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.565625 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.566545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.566973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.663037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-81b2a536-151f-4a9b-8baf-30d7bfbbb419 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.109424 Jan 19 01:04:56.663763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 440/922] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:56 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:56.761473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:56.762499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:56.769134 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.769621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.770425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:56.770878 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:56.888152 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-534dd27f-dd59-4aa0-9911-5dd74489136a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.130223 Jan 19 01:04:56.889110 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 483/923] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:56 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:57.230703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:57.231451 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:57.238883 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.239332 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.240128 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.240567 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.399078 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca01c95ab3c43cea84100055c870366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a740c1bb3e424287752ebd823d57ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:04:57.409852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5721323f-45d9-4526-8b7b-dc97a3465a7c tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 200 len: 1554 microversion: 2.1 time: 0.182389 Jan 19 01:04:57.410170 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 441/924] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:57 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:57.643783 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-321b23d0-2fb5-446c-bbdf-87520d88f449 req-38f987fd-4189-41ac-a65d-5b8c4ce4922d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9e8236-4e4c-4513-9f9d-9e734f41c21f", "name": "network-vif-deleted", "tag": "9758b8ed-8939-4a51-8bec-bc88b27b6d7d"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:57.645982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:04:57.645982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:04:57.655713 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-321b23d0-2fb5-446c-bbdf-87520d88f449 req-38f987fd-4189-41ac-a65d-5b8c4ce4922d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.656088 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-321b23d0-2fb5-446c-bbdf-87520d88f449 req-38f987fd-4189-41ac-a65d-5b8c4ce4922d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.669614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-321b23d0-2fb5-446c-bbdf-87520d88f449 req-38f987fd-4189-41ac-a65d-5b8c4ce4922d service nova] Creating event network-vif-deleted:9758b8ed-8939-4a51-8bec-bc88b27b6d7d for instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f on hv-cinder-79987 Jan 19 01:04:57.675542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:57.677243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:57.677536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-321b23d0-2fb5-446c-bbdf-87520d88f449 req-38f987fd-4189-41ac-a65d-5b8c4ce4922d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Jan 19 01:04:57.678511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 484/925] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:04:57.683247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.683693 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.684497 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.684926 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.816919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-24584f7c-acae-43f3-877c-445cd957524c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.146112 Jan 19 01:04:57.818337 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 442/926] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:57 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:04:57.901304 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:57.902340 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:57.909871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.910383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:57.911058 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:57.911544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:58.012138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c69b1ca7-f36c-48c7-af24-465d4eeaca0e tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.114954 Jan 19 01:04:58.013220 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 485/927] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:57 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 01:04:58.429248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:58.430016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] [instance: 4a9e8236-4e4c-4513-9f9d-9e734f41c21f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:58.437357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:58.438468 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:58.439281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:58.439722 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:58.457112 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] HTTP exception thrown: Instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f could not be found. Jan 19 01:04:58.457656 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Returning 404 to user: Instance 4a9e8236-4e4c-4513-9f9d-9e734f41c21f could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:04:58.458506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-908b16c4-c876-4672-895d-bc2eedc21fb1 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f" status: 404 len: 111 microversion: 2.1 time: 0.033981 Jan 19 01:04:58.459084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 443/928] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:04:58 2022] GET /compute/v2.1/servers/4a9e8236-4e4c-4513-9f9d-9e734f41c21f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:04:58.468506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-12d851c2-49b1-48b3-a252-50630b18d014 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] Calling method '.version_select at 0x7f934c7a75e0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:04:58.490606 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-12d851c2-49b1-48b3-a252-50630b18d014 tempest-TestMinimumBasicScenario-793387842 tempest-TestMinimumBasicScenario-793387842-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-451802842" status: 202 len: 0 microversion: 2.1 time: 0.026465 Jan 19 01:04:58.491268 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 486/929] 10.222.0.35 () {58 vars in 1268 bytes} [Wed Jan 19 01:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-451802842 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:04:58.828080 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:58.829646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:58.838768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:58.839380 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:58.840235 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:58.840582 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:58.951879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-30bb7ebc-56bc-4510-a969-bc1710350055 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.127024 Jan 19 01:04:58.952441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 444/930] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:58 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:04:59.026049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:59.027170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:59.038493 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:59.042322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:59.044228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:59.044852 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:59.149761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-361eceba-84af-4d98-ab3f-faa0fd9789ac tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.129273 Jan 19 01:04:59.151394 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 487/931] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:04:59 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:04:59.963570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:04:59.964686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:04:59.971872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:59.972327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:04:59.973116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:04:59.973707 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:00.060028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-af967a37-94c8-40f1-b6b1-218032cadae3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 14 microversion: 2.20 time: 0.100642 Jan 19 01:05:00.060666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 445/932] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:04:59 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:05:00.162084 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:00.163038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:00.170193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:00.170664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:00.171469 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:00.171934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:00.257784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1a48a0d5-434d-4ab3-8a17-4e7f118b9da9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.099706 Jan 19 01:05:00.258531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 488/933] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:00 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:05:01.072745 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:01.073807 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:01.081880 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:01.082339 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:01.083142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:01.083638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:01.200876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ed0a8102-14c0-43ff-8df1-7812be74e666 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 6451 microversion: 2.20 time: 0.131461 Jan 19 01:05:01.208991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 446/934] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:01 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 6451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:01.269825 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:01.270800 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:01.277959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:01.278341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:01.279178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:01.279605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:01.377856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-292d60db-bbc2-41a2-adcf-a657b7e64d1c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14 microversion: 2.1 time: 0.112803 Jan 19 01:05:01.381077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 489/935] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:01 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:05:02.217067 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:02.218275 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:02.230195 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:02.230655 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:02.231659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:02.234398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:02.351904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bbce42ac-0c53-42b2-8e61-cb2e7a4044a2 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 13107 microversion: 2.20 time: 0.138830 Jan 19 01:05:02.354672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 447/936] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:02 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 13107 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:02.393700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:02.396069 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:02.418156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:02.419500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:02.421197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:02.427376 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:02.567329 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1f22bf74-298d-4340-a275-13e9673aec75 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 6184 microversion: 2.1 time: 0.181425 Jan 19 01:05:02.571128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 490/937] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:02 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 6184 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:03.366850 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:03.367986 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:03.375728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:03.376304 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:03.377202 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:03.377755 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:03.480186 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ffb57542-16a3-4775-9b8a-db8e48834ef6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 17401 microversion: 2.20 time: 0.116909 Jan 19 01:05:03.484271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 448/938] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:03 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 17401 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:03.584749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:03.588200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:03.601083 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:03.601928 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:03.603375 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:03.604178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:03.726467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7f1fbf8f-7adc-4b03-b15e-e0162fec7f88 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 14483 microversion: 2.1 time: 0.149987 Jan 19 01:05:03.727485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 491/939] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:03 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 14483 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:04.494972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:04.496720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:04.509380 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:04.510217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:04.511971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:04.512516 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:04.615357 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9deb321c-5ea8-41c3-b10d-c7a7ccb7dd65 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 18056 microversion: 2.20 time: 0.126376 Jan 19 01:05:04.616528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 449/940] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:04 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 18056 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:04.739410 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:04.740440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:04.747885 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:04.748243 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:04.749276 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:04.749753 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:04.856155 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-09657788-6c46-41fe-bcbb-b0756062db7c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 18102 microversion: 2.1 time: 0.121179 Jan 19 01:05:04.856991 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 492/941] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:04 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 18102 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:05.631806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:05.633232 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:05.644374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:05.645065 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:05.646406 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:05.647359 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:05.774281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f8b1ce9c-860d-42a8-952e-ffbc2c7260d3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 20193 microversion: 2.20 time: 0.148680 Jan 19 01:05:05.775584 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 450/942] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:05 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 20193 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:05.874066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:05.874620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:05.882232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:05.882762 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:05.883486 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:05.883933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:05.986274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-baf0428d-024a-401e-b53b-7ba35cd90904 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 19342 microversion: 2.1 time: 0.121157 Jan 19 01:05:05.988456 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 493/943] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:05 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 19342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:05:06.789149 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:06.790987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:06.805183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:06.805759 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:06.806824 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:06.807092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:07.001012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:07.002161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:07.009362 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:07.009855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:07.010675 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:07.011121 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:09.299184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3d4dc921-a61b-4eb3-b705-abe2b946d83c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 25344 microversion: 2.20 time: 2.515484 Jan 19 01:05:09.300113 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 451/944] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:06 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 25344 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:09.333426 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b29b3099-d3ad-4a20-b693-8af761760415 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 24856 microversion: 2.1 time: 2.336843 Jan 19 01:05:09.334161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 494/945] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:06 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 24856 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:10.315822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:10.316884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:10.325756 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:10.326326 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:10.327204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:10.327648 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:10.346193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:10.347374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:10.356109 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:10.356559 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:10.358258 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:10.358889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:10.460325 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fe5be7ed-bb85-4a03-b8ac-7332dfe4fa92 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 26076 microversion: 2.20 time: 0.149900 Jan 19 01:05:10.461367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 452/946] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:10 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 26076 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:10.515467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7a9b8ec0-0003-466f-b7e9-a9486623c9e4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 25883 microversion: 2.1 time: 0.171559 Jan 19 01:05:10.516193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 495/947] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:10 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 25883 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:11.476671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:11.477899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:11.487447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:11.487998 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:11.488921 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:11.489396 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:11.527879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:11.528916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:11.538108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:11.538589 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:11.539784 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:11.540569 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:11.599312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3b37d1f4-4d0c-419e-b510-9a219abb4266 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 26979 microversion: 2.20 time: 0.128479 Jan 19 01:05:11.603541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 453/948] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:11 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 26979 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:11.669500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ab1cf582-3935-4bc5-a6d7-5848cdfb2ed0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 26797 microversion: 2.1 time: 0.145594 Jan 19 01:05:11.670208 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 496/949] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:11 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 26797 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:12.612945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:12.614020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:12.621728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:12.622191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:12.622996 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:12.623441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:12.683623 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:12.684641 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:12.692867 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:12.693321 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:12.694183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:12.694626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:12.724016 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e584eb21-7287-4f5f-9483-f538bcc93687 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 27590 microversion: 2.20 time: 0.115899 Jan 19 01:05:12.724674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 454/950] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:12 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 27590 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:12.810778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bb3e3a22-5912-4dac-aada-0841e58e2c44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 27540 microversion: 2.1 time: 0.131205 Jan 19 01:05:12.811437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 497/951] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:12 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 27540 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:13.736418 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:13.737528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:13.744612 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:13.745060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:13.745889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:13.746329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:13.823345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:13.824367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:13.832092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:13.832548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:13.833349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:13.833827 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:16.222199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9328b9c0-7da8-4c6b-812d-6ba699f36367 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28196 microversion: 2.20 time: 2.489750 Jan 19 01:05:16.223142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 455/952] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:13 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28196 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:16.260737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-13d86f90-218c-440b-989c-67d9076e97f6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28258 microversion: 2.1 time: 2.441241 Jan 19 01:05:16.261474 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 498/953] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:13 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28258 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:17.234522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:17.235674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:17.245840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:17.246295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:17.247097 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:17.247542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:17.282758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:17.284968 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:17.299259 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:17.300435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:17.302063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:17.303074 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:17.347318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-47bf9138-0630-45f4-a6e4-c3fb3f2b48fa tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28196 microversion: 2.20 time: 0.116689 Jan 19 01:05:17.349152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 456/954] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:17 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28196 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:17.421169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-bedbbac7-051d-4b64-aa71-bec7838d553a tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28258 microversion: 2.1 time: 0.148235 Jan 19 01:05:17.423664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 499/955] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:17 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:05:18.361655 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:18.362846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:18.369838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:18.370288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:18.371091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:18.371531 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:18.434481 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:18.435499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:18.443316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:18.443776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:18.444573 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:18.445015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:18.471952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0574b781-326a-4a68-87c4-a382aeac945c tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28487 microversion: 2.20 time: 0.114162 Jan 19 01:05:18.472634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 457/956] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:18 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28487 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:18.544616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-91fc35ba-4527-45ac-b5f8-4a32332756c9 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28549 microversion: 2.1 time: 0.114124 Jan 19 01:05:18.545314 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 500/957] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:18 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28549 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:19.484834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:19.485830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:19.493042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:19.493490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:19.494356 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:19.494770 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:19.557089 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:19.558169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:19.568349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:19.569881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:19.570763 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:19.571213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:19.593420 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-88f6d6cc-8842-490b-b448-f2ffee9c2665 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28655 microversion: 2.20 time: 0.112903 Jan 19 01:05:19.594157 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 458/958] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:19 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:19.669958 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b85d7168-3c76-42cc-87cc-2433e3c0e369 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28717 microversion: 2.1 time: 0.116768 Jan 19 01:05:19.670863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 501/959] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:19 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28717 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:20.606790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:20.607796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:20.616241 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:20.616698 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:20.617486 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:20.617953 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:20.682369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:20.683294 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:20.689980 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:20.690437 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:20.691239 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:20.691686 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:20.710297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1bc3ad79-e599-4f9a-8402-790c55af4a84 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28655 microversion: 2.20 time: 0.107404 Jan 19 01:05:20.714343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 459/960] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:20 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:20.780052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a1e20abc-dc02-4238-8374-0582ff9f2528 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28717 microversion: 2.1 time: 0.101634 Jan 19 01:05:20.780803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 502/961] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:20 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28717 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:21.723297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:21.724938 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:21.731199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:21.731653 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:21.732435 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:21.732872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:21.792653 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:21.793676 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:21.800672 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:21.801120 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:21.801925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:21.802388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:21.826577 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d4954dd6-f3ad-48a5-a420-d10fdd31f0e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28655 microversion: 2.20 time: 0.107788 Jan 19 01:05:21.830049 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 460/962] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:21 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:21.901962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3d387c9d-68b3-4450-becc-a8b1e5a66b44 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28717 microversion: 2.1 time: 0.113067 Jan 19 01:05:21.905861 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 503/963] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:21 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28717 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:22.838385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:22.839533 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:22.847172 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:22.847630 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:22.848420 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:22.848870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:22.914132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:22.915166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:22.923440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:22.924021 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:22.925321 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:22.925883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:22.941667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6584622b-992e-4dea-895f-70057437f242 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 28655 microversion: 2.20 time: 0.107046 Jan 19 01:05:22.946899 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 461/964] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:22 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:23.018417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5719a430-44f6-4e2d-947b-edcd2a5ac6db tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 28717 microversion: 2.1 time: 0.108063 Jan 19 01:05:23.019241 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 504/965] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:22 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 28717 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:23.856249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:23.856975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:23.864889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:23.865340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:23.866162 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:23.866772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:23.895796 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lazy-loading 'flavor' on Instance uuid 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:05:23.977408 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:23.979960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:23.993269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:23.995246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:23.996961 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:23.998037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:24.037668 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ab63ebbc-f202-4ec4-a0c8-4bf2769f85d1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "POST /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527/action" status: 202 len: 0 microversion: 2.1 time: 0.185252 Jan 19 01:05:24.042331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 462/966] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:23 2022] POST /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:24.048465 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:24.050329 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:24.059368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:24.059729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:24.060898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:24.061423 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:24.140583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c5de1b02-72e4-46e8-baff-165c1de41920 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 29788 microversion: 2.20 time: 0.188404 Jan 19 01:05:24.141232 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 505/967] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:23 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 29788 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:24.146601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:24.147374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:24.154242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:24.154774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:24.155637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:24.156156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:24.246063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e76efc59-7a90-4fbf-8434-b40ceea1353c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 29546 microversion: 2.1 time: 0.202116 Jan 19 01:05:24.246715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 463/968] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:24 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 29546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:05:24.308214 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:24.315973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7f935aa9-0704-4b5b-bc0f-2de7fdddaecc tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.173309 Jan 19 01:05:24.316728 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 506/969] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:24 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:25.153737 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:25.154747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:25.162133 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.162583 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.163395 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.163838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.259797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:25.260734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:25.271279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.271734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.272543 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.273583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.273895 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-95161704-7bb3-4622-be5d-9d0df6a2efba tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 31491 microversion: 2.20 time: 0.124121 Jan 19 01:05:25.274717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 464/970] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:25 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 31491 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:25.334785 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:25.335526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:25.342655 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.343113 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.343972 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:25.344416 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:25.374092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-296e7f74-a927-4c9d-b2dd-b32f9158b6e3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 31416 microversion: 2.1 time: 0.118876 Jan 19 01:05:25.376244 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 507/971] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:25 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 31416 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:25.481084 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:25.489373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-21498102-3755-4db8-b493-968a32d48290 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.158634 Jan 19 01:05:25.489985 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 465/972] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:25 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:05:26.287339 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:26.288484 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:26.295717 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.296120 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.297511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.298087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.386589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:26.387495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:26.394439 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.394889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.395652 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.396086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.402671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1e08ef58-5431-47f3-88cb-4414c38829bb tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 32948 microversion: 2.20 time: 0.119600 Jan 19 01:05:26.406700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 508/973] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:26 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 32948 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:26.507454 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:26.508156 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:26.508529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5fe2cf21-1ec5-451a-af7e-3a5c88bd2a46 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 32983 microversion: 2.1 time: 0.125699 Jan 19 01:05:26.509430 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 466/974] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:26 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 32983 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:26.515127 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.515584 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.516434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:26.516881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:26.649919 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:26.658112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f26a22ee-0f7e-475e-8b1d-042ddabdb4a1 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.154783 Jan 19 01:05:26.658683 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 509/975] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:26 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:27.414728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:27.415729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:27.422529 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:27.422981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:27.423757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:27.424201 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:27.521130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:27.522012 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:27.528440 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:27.528894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:27.529738 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:27.530187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:29.102377 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-35ae9b07-316e-47bb-8b16-ff2c0c0202b7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 35027 microversion: 2.20 time: 1.691529 Jan 19 01:05:29.103031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 467/976] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:27 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 35027 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:29.107852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:29.108534 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:29.116450 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:29.116896 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:29.117692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:29.118125 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:29.135507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-04b2064c-18cb-4ba5-bf2d-66aa36474c27 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 35231 microversion: 2.1 time: 1.617946 Jan 19 01:05:29.138599 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 510/977] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:27 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 35231 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:29.256245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:29.263929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3ff5dcbf-ebfb-40f0-b075-5fa6b8ac7be0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.159666 Jan 19 01:05:29.264513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 468/978] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:29 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:30.115535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:30.116588 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:30.123367 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:30.123819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:30.124597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:30.125056 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:30.147432 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:30.148466 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:30.154758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:30.155217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:30.156003 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:30.156445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:32.382973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1f848485-a27a-4f32-b76d-d31d85b66429 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 38207 microversion: 2.20 time: 2.271355 Jan 19 01:05:32.383946 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 511/979] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:30 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 38207 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:32.389015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:32.389811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:32.398082 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:32.398534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:32.399333 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:32.399772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:32.437086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-164c11bd-c22a-4e96-aa57-fbbd5cb605ea tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 38242 microversion: 2.1 time: 2.293133 Jan 19 01:05:32.438747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 469/980] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:30 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 38242 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:32.540254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:32.547978 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d7e21bd1-ce5d-4c89-977b-6c412889baf0 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.162827 Jan 19 01:05:32.548568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 512/981] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:32 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:33.396015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:33.397045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:33.403867 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:33.404315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:33.405106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:33.405536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:33.449506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:33.450380 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:33.456712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:33.457173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:33.458003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:33.458450 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:35.688265 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b3c881db-c3c1-4c69-ac10-0befc055e1f8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 38207 microversion: 2.20 time: 2.296209 Jan 19 01:05:35.688964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 470/982] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:33 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 38207 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:35.693805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:35.694515 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:35.702143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:35.702599 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:35.703392 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:35.703833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:35.704360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-934f7c49-dd5b-4857-9381-30535d4cf994 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 38242 microversion: 2.1 time: 2.258479 Jan 19 01:05:35.708027 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 513/983] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:33 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 38242 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:35.845729 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:35.853911 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b68551ca-db42-457a-990e-8a1cad065e63 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.163729 Jan 19 01:05:35.854541 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 471/984] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:35 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:36.701017 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:36.701984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:36.708843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.709420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:36.710183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.710614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:36.716244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:36.717191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:36.724002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.724450 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:36.725243 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.725705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:36.824963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-42a51cdd-4402-400f-9b2d-e77f4148bfe8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 38210 microversion: 2.20 time: 0.127968 Jan 19 01:05:36.825769 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 514/985] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:36 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 38210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:36.857070 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e042d03d-206f-4475-9062-1110c789e022 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 38254 microversion: 2.1 time: 0.144262 Jan 19 01:05:36.857781 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 472/986] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:36 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 38254 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:36.871838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:36.872548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:36.880001 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.880460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:36.881246 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:36.881728 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.022708 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:37.031638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2e7bcfc6-4499-4246-bb8e-3c3788c2aa02 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.163859 Jan 19 01:05:37.032731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 515/987] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:36 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:37.836772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:37.837811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:37.844606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.845060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.845865 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.846299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.868997 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:37.869959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:37.877700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.878148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.878933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.879369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.954363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7f9a70d1-48cc-48fd-b609-7e485bc32bb9 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 200 len: 38350 microversion: 2.20 time: 0.121324 Jan 19 01:05:37.956349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 473/988] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:37 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 38350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:37.966081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:37.966661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:37.973958 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.974401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.975175 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:37.975627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:37.989114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-52ef9889-3057-4420-8ce8-9d40359651f3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action" status: 200 len: 38371 microversion: 2.1 time: 0.123679 Jan 19 01:05:37.994623 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 516/989] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:37 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/action => generated 38371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:37.999481 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9383ef8d-b418-4f96-ae70-14099bc8fecc tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/ips" status: 200 len: 153 microversion: 2.20 time: 0.037282 Jan 19 01:05:37.999912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:38.000043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 474/990] 10.222.0.35 () {60 vars in 1288 bytes} [Wed Jan 19 01:05:37 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 01:05:38.000501 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:38.008545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:38.009039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:38.009943 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:38.010392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:38.036174 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a353accd-daf7-4af7-81e3-c59144b7fc7b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/ips" status: 200 len: 146 microversion: 2.1 time: 0.040119 Jan 19 01:05:38.036842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 517/991] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 01:05:37 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:38.050130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:38.050848 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:38.057299 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:38.057859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:38.058717 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:38.059229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:38.201399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:38.209347 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-93c1dfbd-a5a8-47c4-ade4-c90656d3d78e tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.163597 Jan 19 01:05:38.210522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 475/992] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:38 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:39.226023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:39.226639 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:39.232832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:39.233285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:39.234105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:39.234538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:39.364412 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0068942d-acae-43df-a42f-f6abfc9c6289"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:39.365485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:39.372214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:39.372670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:39.373476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:39.373937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:39.386229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:39.395913 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8c9119e7-eaf6-4d7c-b511-c58a88dc0d95 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.173215 Jan 19 01:05:39.396595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 518/993] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:39 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:39.639020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ea2a0dbf-abe0-422c-8774-acabd4190fcd tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278266 Jan 19 01:05:39.639716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 476/994] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:05:39 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:40.215049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:40.215618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:40.222443 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.222898 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.223675 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.224113 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.246653 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lazy-loading 'flavor' on Instance uuid 4efcf53c-ea61-4e06-851f-f661dff08fab {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:05:40.415553 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:40.416732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:40.425291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.425780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.426573 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.427092 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.512296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8607594f-e6a1-47ee-9bf5-841ebd76a789 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 202 len: 0 microversion: 2.20 time: 0.300846 Jan 19 01:05:40.515815 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 519/995] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:05:40 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:05:40.523513 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:40.524735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:40.531490 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.531963 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.532807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:40.533892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:40.584617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:40.592064 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b967af33-cd05-4d0e-bbfd-e46d9ffdb3e4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.181820 Jan 19 01:05:40.592723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 477/996] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:40 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:05:40.671643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:40.680351 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:40.681923 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:40.683204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0a18cb91-5f61-4daf-8c7a-767c5fe86a39 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.165698 Jan 19 01:05:40.683852 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 520/997] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:40 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:05:41.609037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:41.609499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:41.616762 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:41.617184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:41.618204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:41.618814 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:41.703503 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:41.704192 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:41.710982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:41.711955 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:41.712468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:41.713109 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:41.776339 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:41.786158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3bdbc8b0-25d3-4fe9-9353-78fe5d3e64f4 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.180756 Jan 19 01:05:41.796827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 478/998] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:41 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:41.878721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:41.886872 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:41.888423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:41.889662 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-03de958e-1f68-423a-b785-ba5a85e0904e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.191640 Jan 19 01:05:41.890184 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 521/999] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:41 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:42.804453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:42.805041 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:42.811231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:42.811677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:42.812438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:42.812872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:42.908468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:42.909188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:42.915499 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:42.916029 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:42.916820 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:42.917261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:42.944308 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:42.952485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b7f4ab78-2b51-446a-9fe5-bebbab161220 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.151512 Jan 19 01:05:42.953355 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 479/1000] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:42 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:43.047799 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:43.055837 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:43.057292 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:43.058483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f35eb13d-8f2a-4033-a669-ff4d4de6a7ee tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.154272 Jan 19 01:05:43.059056 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 522/1001] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:42 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:43.969460 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:43.970116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:43.977114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:43.977579 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:43.978383 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:43.978819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.075987 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:44.076609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:44.083818 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.084283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.085080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.085661 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.119540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:44.127268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-51461afa-97cc-4ede-aaa4-8109ea9e5769 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1507 microversion: 2.1 time: 0.161385 Jan 19 01:05:44.127792 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 480/1002] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:43 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:44.144106 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:44.144671 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:44.150538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.150987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.151772 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.152204 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.219629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:44.228200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:44.229741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:44.230930 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ef145a17-ee79-4d9b-8dde-466c178c2cd5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.158736 Jan 19 01:05:44.231495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 523/1003] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:44 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:05:44.336749 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e7125d9b-46cc-472d-b952-16b35cf8c7ca tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "POST /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527/action" status: 202 len: 0 microversion: 2.1 time: 0.196882 Jan 19 01:05:44.337685 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 481/1004] 10.222.0.35 () {60 vars in 1277 bytes} [Wed Jan 19 01:05:44 2022] POST /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:44.347691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:44.348770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:44.354650 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.355112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.356093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:44.356447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:44.530225 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:44.537871 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0b568042-b96b-404a-b0ec-433472139340 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1515 microversion: 2.1 time: 0.195543 Jan 19 01:05:44.538459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 524/1005] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:44 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:45.249385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:45.250020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:45.256173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:45.256626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:45.257425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:45.257889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:45.386974 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:45.396222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:45.397757 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:45.398923 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f98718a6-f288-4722-a8bf-909bfec8c380 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.153793 Jan 19 01:05:45.399494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 482/1006] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:45 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:45.555182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:45.555709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:45.561905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:45.562357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:45.563130 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:45.563562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:45.695459 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:45.702770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-79436863-5e86-406b-8cea-584f73f52170 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1517 microversion: 2.1 time: 0.151353 Jan 19 01:05:45.703346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 525/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:45 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:46.283691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-e2b3927b-cfd6-4f03-bb84-8543b9bf2799 req-1d773667-2e75-4960-b3e0-dc172205cff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "name": "network-vif-unplugged", "status": "completed", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:46.286427 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:05:46.286427 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:05:46.296174 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-e2b3927b-cfd6-4f03-bb84-8543b9bf2799 req-1d773667-2e75-4960-b3e0-dc172205cff8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:46.296808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-e2b3927b-cfd6-4f03-bb84-8543b9bf2799 req-1d773667-2e75-4960-b3e0-dc172205cff8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:46.309513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.compute.server_external_events [req-e2b3927b-cfd6-4f03-bb84-8543b9bf2799 req-1d773667-2e75-4960-b3e0-dc172205cff8 service nova] Unable to find a host for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527. Dropping event network-vif-unplugged {{(pid=116543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 19 01:05:46.310441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-e2b3927b-cfd6-4f03-bb84-8543b9bf2799 req-1d773667-2e75-4960-b3e0-dc172205cff8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032623 Jan 19 01:05:46.311210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 483/1008] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 19 01:05:46.417536 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:46.418191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:46.425377 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:46.425854 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:46.426658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:46.427129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:46.568010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:46.576242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:46.577798 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:46.579018 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4d701806-d56b-499f-a692-c3cbf4801fb0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.165375 Jan 19 01:05:46.580105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 526/1009] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:46 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:46.720113 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:46.720743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:46.726989 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:46.727443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:46.728249 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:46.728687 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:46.862731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:46.869943 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0a794397-9888-41f0-be16-bdc00b3a5a01 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1517 microversion: 2.1 time: 0.153532 Jan 19 01:05:46.870506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 484/1010] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:46 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:47.126193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:47.127934 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:47.134430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.134925 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.135788 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.136309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.167439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ef20f916-114e-4024-9af5-cdf95a73c240 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Jan 19 01:05:47.168010 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 527/1011] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:05:47 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:47.177949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:47.178438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:47.184542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.185035 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.185919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.186292 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.215320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e7a6073f-b8e1-468f-8287-d28fe9659b98 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289" status: 200 len: 194 microversion: 2.1 time: 0.041387 Jan 19 01:05:47.215911 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 485/1012] 10.222.0.35 () {58 vars in 1412 bytes} [Wed Jan 19 01:05:47 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:47.597075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:47.597673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:47.604042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.604497 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.605301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.605771 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.777781 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:47.786015 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:47.787529 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:47.788724 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-69d4f9b8-96f7-4c8d-b883-e09da98b60e1 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.195636 Jan 19 01:05:47.789298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 528/1013] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:47 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:47.887604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:47.888446 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:47.897254 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.898220 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:47.899312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:47.899996 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:48.047542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:48.056152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c6f2c6d7-03aa-4b40-a650-4412ad1e455f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.172474 Jan 19 01:05:48.056935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 486/1014] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:47 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:48.546737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdb648c7-bd6b-4f4b-a265-a542eab44cf5"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:48.547833 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:48.553962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:48.554417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:48.555195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:48.555635 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:48.807769 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:48.808561 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:48.815425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:48.815906 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:48.816825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:48.817336 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:48.823912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-01f58a70-0bf0-451b-b42d-71cc000e46b4 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280887 Jan 19 01:05:48.824716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 529/1015] 10.222.0.35 () {60 vars in 1322 bytes} [Wed Jan 19 01:05:48 2022] POST /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:48.968125 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:48.976331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:48.977854 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:48.979023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-53440d5a-2c5f-46f9-a78f-b260da39b643 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.175155 Jan 19 01:05:48.979619 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 487/1016] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:48 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:05:49.075131 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:49.075839 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:49.083087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:49.083491 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:49.084298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:49.084743 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:49.225792 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:49.234003 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-9cd87adf-d4ed-4ad8-abd1-4e08e6bd6b8a tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.163374 Jan 19 01:05:49.234605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 530/1017] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:49 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:50.005165 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:50.005877 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:50.012231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:50.012678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:50.013461 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:50.013919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:50.145689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:50.153593 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:50.155100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:50.156256 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d1a6b900-7eb6-424b-a94f-ed9de62f82da tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.155029 Jan 19 01:05:50.156818 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 488/1018] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:50 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:50.253391 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:50.254042 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:50.260423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:50.260904 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:50.261712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:50.262164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:50.644895 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:50.653076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a2e4efc8-a6e2-4d30-9adf-5154865f28e8 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.403331 Jan 19 01:05:50.653696 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 531/1019] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:50 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:51.175297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:51.175912 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:51.183224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:51.183677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:51.184497 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:51.184941 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:51.320403 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:51.328827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:51.330416 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:51.331636 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fba7496f-e02b-4b46-a92e-42e3605a2959 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.160382 Jan 19 01:05:51.332222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 489/1020] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:51 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:51.675341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:51.676528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:51.687950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:51.688767 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:51.690262 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:51.691053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:51.834716 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:51.844801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fabc02fb-bd3c-4498-932c-62b3f0c6c008 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.176612 Jan 19 01:05:51.845405 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 532/1021] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:51 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:52.349528 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:52.350177 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:52.356829 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:52.357279 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:52.358123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:52.358570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:52.522691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:52.531152 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:52.532702 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:52.533927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1fa7d421-767c-42ba-aea9-dd5dbfa0dab4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.188230 Jan 19 01:05:52.534503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 490/1022] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:52 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:52.863229 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:52.863859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:52.870538 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:52.871005 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:52.871826 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:52.872264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:53.019326 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:53.027247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-58cff486-a6c2-4ef0-ac52-29af11471588 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.168267 Jan 19 01:05:53.027853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 533/1023] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:52 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:53.553137 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:53.553786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:53.563658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:53.564507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:53.566554 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:53.567344 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:53.743383 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:53.752536 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:53.755022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:53.756977 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6005bf79-6e3d-47ed-8fc2-467868d2cb8e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.208214 Jan 19 01:05:53.757950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 491/1024] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:53 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:05:54.045466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:54.046119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:54.053806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:54.054271 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:54.055087 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:54.055532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:54.220181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:54.231468 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2cc79837-2963-43b3-a492-9f197334699f tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.189507 Jan 19 01:05:54.232122 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 534/1025] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:54 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:54.780231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:54.780880 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:54.788455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:54.788914 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:54.789720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:54.790236 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:54.947475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:54.961281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:54.962824 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:54.964033 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1307271c-8057-4c58-8187-1ce41cd17320 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.187715 Jan 19 01:05:54.964613 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 492/1026] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:54 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:55.256140 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:55.256775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:55.263749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:55.264283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:55.265037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:55.265487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:55.442673 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:55.451242 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-96202940-a1df-4760-8a23-967416bd8e10 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.199484 Jan 19 01:05:55.451982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 535/1027] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:55 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:55.982925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:55.983524 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:55.991375 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:55.991830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:55.992646 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:55.993090 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.161469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:56.176017 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:56.179189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:56.181301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-39504fbd-e246-4967-a4a8-689988b364a3 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.201769 Jan 19 01:05:56.182413 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 493/1028] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:55 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:56.361984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:56.363025 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:56.369944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.370398 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.371224 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.372024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.428441 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a22336e0-7d26-4698-bda8-f560ddc6c825 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069936 Jan 19 01:05:56.429701 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 536/1029] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:05:56 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:56.469613 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:56.470385 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:56.477323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.477987 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.478827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.479494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.646199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:56.656214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1bf094d6-1b13-4a91-bce6-b7f3d9bcde93 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.190476 Jan 19 01:05:56.656801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 494/1030] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:56 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:56.744114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:56.744609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:56.751078 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.751531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.752346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.753341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.784689 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d3e7b2e9-feef-4f3e-b729-beb44b986bb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289" status: 200 len: 194 microversion: 2.1 time: 0.044354 Jan 19 01:05:56.785522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 537/1031] 10.222.0.35 () {58 vars in 1412 bytes} [Wed Jan 19 01:05:56 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:56.795238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:56.795730 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:56.802766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.803217 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.804020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:56.804457 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:56.901956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lazy-loading 'services' on Instance uuid 3afcb7dd-d512-4061-a2da-c747612ed110 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:05:56.981320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dd9457d1-ff65-42e3-ae86-1e2d5de68fb3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289" status: 202 len: 0 microversion: 2.1 time: 0.189579 Jan 19 01:05:56.984985 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 495/1032] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:05:56 2022] DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/0068942d-acae-43df-a42f-f6abfc9c6289 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:05:57.210568 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:57.211894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:57.221031 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:57.222684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:57.223774 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:57.224567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:57.411862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:57.421146 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:57.422717 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:57.423969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-29e77cc9-0f64-4b84-9c5d-27bbab641703 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1745 microversion: 2.20 time: 0.219118 Jan 19 01:05:57.425432 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 538/1033] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:57 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:57.678362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:57.679006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:57.685740 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:57.686163 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:57.686968 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:57.687410 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:57.847278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:57.855324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-526a9bd0-23bc-4a99-9186-455065fac883 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.184217 Jan 19 01:05:57.855920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 496/1034] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:57 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:58.449415 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:58.451286 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:58.462197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:58.463244 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:58.465374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:58.466572 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:58.639782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-c4e7916b-3c99-4e73-af9e-88c2373a2898 req-4912ef7a-3d09-4afc-8a45-ebfd61755ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "name": "network-vif-plugged", "status": "completed", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:05:58.641819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:05:58.641819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:05:58.653414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-c4e7916b-3c99-4e73-af9e-88c2373a2898 req-4912ef7a-3d09-4afc-8a45-ebfd61755ce2 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:58.653782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-c4e7916b-3c99-4e73-af9e-88c2373a2898 req-4912ef7a-3d09-4afc-8a45-ebfd61755ce2 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:58.666540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-c4e7916b-3c99-4e73-af9e-88c2373a2898 req-4912ef7a-3d09-4afc-8a45-ebfd61755ce2 service nova] Creating event network-vif-plugged:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:05:58.672374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-c4e7916b-3c99-4e73-af9e-88c2373a2898 req-4912ef7a-3d09-4afc-8a45-ebfd61755ce2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038502 Jan 19 01:05:58.673419 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 497/1035] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:05:58.706176 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:58.742933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:58.746575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:58.750112 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fe53ac8f-9253-4855-ac89-3f9fcb942e60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.308049 Jan 19 01:05:58.765600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 539/1036] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:58 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:05:58.874983 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:58.877719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:58.885633 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:58.886487 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:58.887710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:58.888482 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.125126 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:05:59.153130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8e87f90b-cbfd-4566-a65f-a52631c664af tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.282507 Jan 19 01:05:59.158104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 498/1037] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:05:58 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:05:59.227859 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:59.228371 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:59.235118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.235574 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.236385 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.236935 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.308870 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-aac96555-7315-4614-a964-cb68eb2c0019 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/cdb648c7-bd6b-4f4b-a265-a542eab44cf5" status: 200 len: 194 microversion: 2.1 time: 0.084204 Jan 19 01:05:59.310236 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 540/1038] 10.222.0.35 () {58 vars in 1412 bytes} [Wed Jan 19 01:05:59 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/cdb648c7-bd6b-4f4b-a265-a542eab44cf5 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:05:59.325314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:59.326665 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:59.338324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.339008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.340189 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.340718 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.469343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lazy-loading 'services' on Instance uuid 3afcb7dd-d512-4061-a2da-c747612ed110 {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:05:59.567433 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e6b58545-05e6-40ad-b2dc-119c0d08c966 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/cdb648c7-bd6b-4f4b-a265-a542eab44cf5" status: 202 len: 0 microversion: 2.1 time: 0.246894 Jan 19 01:05:59.569999 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 499/1039] 10.222.0.35 () {58 vars in 1415 bytes} [Wed Jan 19 01:05:59 2022] DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments/cdb648c7-bd6b-4f4b-a265-a542eab44cf5 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 01:05:59.781713 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:05:59.783123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:05:59.793159 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.793427 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:05:59.794526 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:05:59.795151 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:00.017321 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:00.037782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:00.040764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:00.042528 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d04b9c54-2a8d-41c5-b211-1e7aabb7d41b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.267458 Jan 19 01:06:00.043194 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 541/1040] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:05:59 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:00.187414 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:00.192860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:00.206939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:00.207660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:00.208686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:00.209323 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:00.498787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:00.509222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-47e6c00d-baf3-4936-b8c3-9f235fcc1132 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1573 microversion: 2.1 time: 0.329996 Jan 19 01:06:00.510413 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 500/1041] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:00 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1573 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:06:00.715343 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-a7041343-7418-4298-9072-c2c62b5aa18e req-33188be4-d39a-4509-a08c-f57ac83cb444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "name": "network-vif-plugged", "status": "completed", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:00.734826 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:06:00.734826 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:06:00.757446 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-a7041343-7418-4298-9072-c2c62b5aa18e req-33188be4-d39a-4509-a08c-f57ac83cb444 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:00.758642 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-a7041343-7418-4298-9072-c2c62b5aa18e req-33188be4-d39a-4509-a08c-f57ac83cb444 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:00.785899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-a7041343-7418-4298-9072-c2c62b5aa18e req-33188be4-d39a-4509-a08c-f57ac83cb444 service nova] Creating event network-vif-plugged:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:06:00.795945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-a7041343-7418-4298-9072-c2c62b5aa18e req-33188be4-d39a-4509-a08c-f57ac83cb444 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103835 Jan 19 01:06:00.797238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 542/1042] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:00.956819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:00.958966 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:00.969764 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:00.971572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:00.973051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:00.974169 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.035526 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1862d639-a5ef-4c4e-ab52-c603a5e6bad6 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085270 Jan 19 01:06:01.044849 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 501/1043] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:06:00 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:06:01.083567 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:01.085516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:01.101907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.102974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.104637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.105772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.274266 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:01.278647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:01.291335 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.292388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.294151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.295312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.358130 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-aa9ec12b-c0dd-4a83-9504-7b0aaae27d81 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092846 Jan 19 01:06:01.360178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 502/1044] 10.222.0.35 () {58 vars in 1301 bytes} [Wed Jan 19 01:06:01 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 01:06:01.414211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:01.433104 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:01.436637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:01.438996 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-878af5af-19fb-437c-b303-51cb165cc615 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.365215 Jan 19 01:06:01.441165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 543/1045] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:01 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:01.498383 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:01.499982 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:01.512647 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.514026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.515870 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.516815 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.535544 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:01.538202 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:01.550164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.551581 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.553160 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.554023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.575520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:06:01.718183 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-499e283e-4e00-4e78-89ab-bda2233e8e90 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 204 len: 0 microversion: 2.1 time: 0.224183 Jan 19 01:06:01.719120 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 503/1046] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:06:01 2022] DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:06:01.734659 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:01.736031 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:01.747076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.748229 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.749804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:01.750590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:01.778485 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:01.798889 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e0dde1a0-7e78-4157-b0c4-eae8c54e43d5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1560 microversion: 2.1 time: 0.271571 Jan 19 01:06:01.801255 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 544/1047] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:01 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1560 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:06:02.010790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:02.031822 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-416a2e1d-d45f-4f30-bc3f-63a2b8ee61c7 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1674 microversion: 2.1 time: 0.306779 Jan 19 01:06:02.038542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 504/1048] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:01 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1674 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:06:02.461883 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:02.471281 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:02.481509 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:02.482278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:02.483282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:02.483858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:02.875184 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:02.889967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:02.891172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:02.892722 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-958808cd-4afe-4b02-9275-ecb89654023e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.436111 Jan 19 01:06:02.903600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 545/1049] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:02 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:03.061001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:03.061934 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:03.073136 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:03.073925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:03.075272 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:03.075856 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:03.338002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:03.353441 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ff060cd1-ce81-4d9b-ae0b-e828fd0a4fe0 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1674 microversion: 2.1 time: 0.296337 Jan 19 01:06:03.354510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 505/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:03 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1674 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:06:03.915388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:03.916357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:03.926969 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:03.927944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:03.929379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:03.930308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:04.319855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:04.343395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:04.345084 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:04.347322 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5480b879-b524-4f48-8dc6-8858caad5b41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.438720 Jan 19 01:06:04.348442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 546/1051] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:03 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:04.377716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:04.379037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:04.386508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:04.387287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:04.388303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:04.388919 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:04.595251 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:04.605315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5f20d697-2c08-4d82-b22d-da11f6a1b390 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1674 microversion: 2.1 time: 0.231490 Jan 19 01:06:04.615719 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 506/1052] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:04 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:06:05.368731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:05.369535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:05.376583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:05.383081 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:05.383081 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:05.383081 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:05.623800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:05.624477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:05.638363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:05.639192 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:05.641710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:05.658240 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:05.740886 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:05.787030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:05.791406 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:05.794912 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7feed573-64de-4566-8232-474bdf8b0335 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.429347 Jan 19 01:06:05.798014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 547/1053] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:05 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:05.808271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb01d5ca22b42bf9c4b07c5d5dc32ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef284d2a245247f7a8561985ecb39098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:05.820455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4592e4da-7bf7-4698-97ca-51c122360876 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 200 len: 1606 microversion: 2.1 time: 0.200785 Jan 19 01:06:05.821649 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 507/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:05 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 1606 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:06:05.833347 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-3d3d52ac-b500-4b95-a905-932de4cb6e65 req-d50bed4a-63e6-4027-9608-3881a7d9afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afcb7dd-d512-4061-a2da-c747612ed110", "name": "network-vif-deleted", "tag": "381ef2e4-65b1-47b4-af5a-b60f3d5edee6"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:05.838261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:06:05.838261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:06:05.848076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3d3d52ac-b500-4b95-a905-932de4cb6e65 req-d50bed4a-63e6-4027-9608-3881a7d9afa4 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:05.848803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3d3d52ac-b500-4b95-a905-932de4cb6e65 req-d50bed4a-63e6-4027-9608-3881a7d9afa4 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:05.861614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-3d3d52ac-b500-4b95-a905-932de4cb6e65 req-d50bed4a-63e6-4027-9608-3881a7d9afa4 service nova] Creating event network-vif-deleted:381ef2e4-65b1-47b4-af5a-b60f3d5edee6 for instance 3afcb7dd-d512-4061-a2da-c747612ed110 on hv-cinder-79987 Jan 19 01:06:05.867659 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-3d3d52ac-b500-4b95-a905-932de4cb6e65 req-d50bed4a-63e6-4027-9608-3881a7d9afa4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066845 Jan 19 01:06:05.868571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 548/1055] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:06.830164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:06.831224 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:06.844959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:06.846801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:06.848259 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:06.848721 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:06.849628 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:06.850032 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:06.857096 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:06.858305 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:06.859945 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:06.860906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:06.883719 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. Jan 19 01:06:06.884950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:06.886064 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6b27f3c0-0070-4ffb-a402-7573852b632c tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 404 len: 111 microversion: 2.1 time: 0.049272 Jan 19 01:06:06.890647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 549/1056] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:06 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:06:06.895764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-77807a54-2581-4709-9cdb-02c2e1c641fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '.version_select at 0x7f9351275790>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:06.926164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-77807a54-2581-4709-9cdb-02c2e1c641fc tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087073868" status: 202 len: 0 microversion: 2.1 time: 0.034047 Jan 19 01:06:06.927464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 550/1057] 10.222.0.35 () {58 vars in 1220 bytes} [Wed Jan 19 01:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087073868 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:06:07.051598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:07.074035 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:07.077343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:07.092388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b506392a-8f66-4453-a973-892991b22d23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.268674 Jan 19 01:06:07.106734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 508/1058] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:06 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:08.112516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:08.113451 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:08.124808 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:08.125388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:08.126413 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:08.127149 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:08.349145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:08.358709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:08.361877 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:08.363966 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b21668c8-f5e0-4a94-8b0e-43e70b6e9a60 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.255318 Jan 19 01:06:08.364834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 551/1059] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:08 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:09.389164 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:09.390503 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:09.399669 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:09.400425 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:09.401245 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:09.401721 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:09.833626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:09.844785 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:09.847222 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:09.848924 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1284567f-62a3-4e1d-9dea-6241fa1e8025 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.463515 Jan 19 01:06:09.850048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 509/1060] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:09 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:10.371073 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:10.371603 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:10.377952 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.378434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:10.379216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.379650 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:10.394540 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. Jan 19 01:06:10.395307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:10.396253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-768f3a21-22ce-46f2-9d2b-63b1fda00ea8 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 404 len: 111 microversion: 2.1 time: 0.028899 Jan 19 01:06:10.396880 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 552/1061] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:06:10 2022] DELETE /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:06:10.404842 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:10.405539 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: 3afcb7dd-d512-4061-a2da-c747612ed110] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:10.415380 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.416180 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:10.417174 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.417624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:10.431679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. Jan 19 01:06:10.432560 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance 3afcb7dd-d512-4061-a2da-c747612ed110 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:10.433597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-75c04dcb-10b6-4784-a867-bca3ff7922b3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110" status: 404 len: 111 microversion: 2.1 time: 0.032463 Jan 19 01:06:10.434679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 510/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:10 2022] GET /compute/v2.1/servers/3afcb7dd-d512-4061-a2da-c747612ed110 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:06:10.871849 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:10.872463 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:10.878903 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.879358 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:10.880137 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:10.880583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:11.012789 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:11.020829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:11.022337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:11.023494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-51c20f0d-e241-412c-b506-054daa3107b4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1740 microversion: 2.20 time: 0.155295 Jan 19 01:06:11.024059 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 553/1063] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:10 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:11.587720 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:11.588324 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:11.594746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:11.595210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:11.596640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:11.597021 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:11.614363 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. Jan 19 01:06:11.615108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:11.616440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-735c60d6-23c5-412e-a328-27e85913f6a3 tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 404 len: 111 microversion: 2.1 time: 0.032499 Jan 19 01:06:11.617155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 511/1064] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:06:11 2022] DELETE /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:06:11.627515 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:11.628506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] [instance: d78e94f1-dc77-4535-8a26-e8ff5d3e7f54] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:11.635999 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:11.636446 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:11.637252 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:11.637734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:11.653804 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] HTTP exception thrown: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. Jan 19 01:06:11.654395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] Returning 404 to user: Instance d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:11.655247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-45242dc3-24d4-401e-b12f-ee5825d3718b tempest-AttachVolumeTestJSON-2001932193 tempest-AttachVolumeTestJSON-2001932193-project] 10.222.0.35 "GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54" status: 404 len: 111 microversion: 2.1 time: 0.032156 Jan 19 01:06:11.655824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 554/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:06:11 2022] GET /compute/v2.1/servers/d78e94f1-dc77-4535-8a26-e8ff5d3e7f54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:06:12.042797 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:12.043712 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:12.050607 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:12.051158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:12.052039 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:12.052594 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:12.242272 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:12.250238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:12.251727 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:12.253666 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-982869e5-c833-48aa-be33-30d9f3541598 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1722 microversion: 2.20 time: 0.214847 Jan 19 01:06:12.254219 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 512/1066] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:12 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:13.273281 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:13.273939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:13.281320 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:13.281830 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:13.282845 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:13.283885 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:13.435014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:13.443842 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:13.445488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:13.447107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7d27bd87-8825-4ad5-a3cd-6fe0c7d6dd9d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1722 microversion: 2.20 time: 0.177436 Jan 19 01:06:13.447523 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 555/1067] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:13 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:14.465688 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:14.467095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:14.473095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:14.473602 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:14.474388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:14.475028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:14.696716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:14.705485 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:14.706947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:14.708122 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8a9ebafb-85f3-4ebd-aa2f-9666d88f7576 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1665 microversion: 2.20 time: 0.246159 Jan 19 01:06:14.708686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 513/1068] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:14 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1665 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:14.725824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb038592-f5d2-473f-a737-d9703f847b8f"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:14.726893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:14.733227 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:14.733735 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:14.734630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:14.735038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.094758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-119a9188-ff92-46f8-b143-cd96d556dc72 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372677 Jan 19 01:06:15.096474 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 556/1069] 10.222.0.35 () {62 vars in 1363 bytes} [Wed Jan 19 01:06:14 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments => generated 188 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 01:06:15.271473 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:15.271971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:15.285373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.286318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.287548 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.288246 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.773063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5fb458ef-432c-4fd9-9b9b-6f3a4fd43215 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments/cb038592-f5d2-473f-a737-d9703f847b8f" status: 202 len: 0 microversion: 2.20 time: 0.505856 Jan 19 01:06:15.773812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 514/1070] 10.222.0.35 () {60 vars in 1456 bytes} [Wed Jan 19 01:06:15 2022] DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments/cb038592-f5d2-473f-a737-d9703f847b8f => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:06:15.849235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:15.849960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:15.856797 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.857244 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.858164 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.858687 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.950723 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c91b5a41-d994-4a4f-8893-a2da2ecb6839 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action" status: 202 len: 0 microversion: 2.20 time: 0.105482 Jan 19 01:06:15.951894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 557/1071] 10.222.0.35 () {62 vars in 1318 bytes} [Wed Jan 19 01:06:15 2022] POST /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:06:15.960410 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:15.961001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:15.967579 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.968094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:15.968893 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:15.969334 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:16.161058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:16.176188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:16.177988 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:16.179188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2de8c19e-d831-4d24-94ac-75aaca22386d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1673 microversion: 2.20 time: 0.222736 Jan 19 01:06:16.179692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 515/1072] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:15 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:16.513456 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-3bb80e19-51cb-4140-a188-25880ffcda76 req-d421f65b-7499-4789-8fe5-4cb36c4bfaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "name": "network-vif-unplugged", "status": "completed", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:16.515401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:06:16.515401 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:06:16.525066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3bb80e19-51cb-4140-a188-25880ffcda76 req-d421f65b-7499-4789-8fe5-4cb36c4bfaf7 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:16.525637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-3bb80e19-51cb-4140-a188-25880ffcda76 req-d421f65b-7499-4789-8fe5-4cb36c4bfaf7 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:16.541511 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.compute.server_external_events [req-3bb80e19-51cb-4140-a188-25880ffcda76 req-d421f65b-7499-4789-8fe5-4cb36c4bfaf7 service nova] Unable to find a host for instance 4efcf53c-ea61-4e06-851f-f661dff08fab. Dropping event network-vif-unplugged {{(pid=116545) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 19 01:06:16.542755 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-3bb80e19-51cb-4140-a188-25880ffcda76 req-d421f65b-7499-4789-8fe5-4cb36c4bfaf7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034090 Jan 19 01:06:16.544006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 558/1073] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 19 01:06:17.140012 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-258d179e-0ac3-4bed-87b5-cb502e13a0f8 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Action: 'create', calling method: .version_select at 0x7f934c62ea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-271803276", "metadata": {"Type": "work"}}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:17.201434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:17.203597 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:17.211274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:17.211930 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:17.212731 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:17.213400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:17.365076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:17.374647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:17.375506 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:17.377516 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6540fd92-9b0e-4cc8-a406-c528dbfa91e4 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1675 microversion: 2.20 time: 0.182462 Jan 19 01:06:17.378162 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 559/1074] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:17 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:17.454428 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-258d179e-0ac3-4bed-87b5-cb502e13a0f8 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.452178 Jan 19 01:06:17.455100 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 516/1075] 10.222.0.35 () {60 vars in 1155 bytes} [Wed Jan 19 01:06:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 19 01:06:17.466159 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b6174fdd-4c41-48c3-bca9-4b5ed29e7931 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c7b05e0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:17.515400 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b6174fdd-4c41-48c3-bca9-4b5ed29e7931 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 200 len: 352 microversion: 2.1 time: 0.052867 Jan 19 01:06:17.516148 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 560/1076] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:06:17 2022] GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:18.398255 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:18.399043 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:18.406626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:18.407186 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:18.408662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:18.409124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:18.531264 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a9895d85-fde1-4e0b-81d6-d79774c9cb10 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c6e8550>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:18.604372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:18.616820 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a9895d85-fde1-4e0b-81d6-d79774c9cb10 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 200 len: 353 microversion: 2.1 time: 0.091316 Jan 19 01:06:18.618076 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 561/1077] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:06:18 2022] GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:18.618886 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:18.621874 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:18.624026 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bf1215a0-a9da-4653-ab65-22d014866b23 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.231226 Jan 19 01:06:18.624813 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 517/1078] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:18 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:18.637803 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-218bd654-f3ce-40f4-b6ec-ce8e42c43180 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c6e8820>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:18.721449 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-218bd654-f3ce-40f4-b6ec-ce8e42c43180 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 200 len: 353 microversion: 2.1 time: 0.091267 Jan 19 01:06:18.722274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 562/1079] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:06:18 2022] GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:06:18.740556 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3000b457-7739-4c74-96ae-25364a6a6ab4 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c62edc0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:18.831284 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3000b457-7739-4c74-96ae-25364a6a6ab4 tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 202 len: 0 microversion: 2.1 time: 0.096777 Jan 19 01:06:18.832890 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 518/1080] 10.222.0.35 () {58 vars in 1247 bytes} [Wed Jan 19 01:06:18 2022] DELETE /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:06:18.845221 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b0c41ade-c01c-403b-90e2-6bcbf930a9fe tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c6e8c10>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:18.921471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b0c41ade-c01c-403b-90e2-6bcbf930a9fe tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 200 len: 352 microversion: 2.1 time: 0.082518 Jan 19 01:06:18.926287 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 563/1081] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:06:18 2022] GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:19.655105 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:19.656120 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:19.664609 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:19.665287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:19.666339 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:19.666925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:19.848732 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:19.860479 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:19.862556 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:19.863780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6477e1af-aad2-4c52-bda3-9287dda6a768 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.214396 Jan 19 01:06:19.864360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 519/1082] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:19 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:19.945933 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8a9cb5d2-aa0b-492f-a063-09b38cce082c tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Calling method '.version_select at 0x7f934c7e49d0>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:20.020245 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-8a9cb5d2-aa0b-492f-a063-09b38cce082c tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] HTTP exception thrown: Volume fbd85b30-2063-4ebe-9767-759bd2f07a1c could not be found. Jan 19 01:06:20.021627 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8a9cb5d2-aa0b-492f-a063-09b38cce082c tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] Returning 404 to user: Volume fbd85b30-2063-4ebe-9767-759bd2f07a1c could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:06:20.023496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8a9cb5d2-aa0b-492f-a063-09b38cce082c tempest-VolumesGetTestJSON-894447647 tempest-VolumesGetTestJSON-894447647-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c" status: 404 len: 109 microversion: 2.1 time: 0.087435 Jan 19 01:06:20.032240 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 564/1083] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:06:19 2022] GET /compute/v2.1/os-volumes/fbd85b30-2063-4ebe-9767-759bd2f07a1c => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:06:20.894159 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:20.894904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:20.902469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:20.903117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:20.905207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:20.905797 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:21.109268 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:21.122532 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:21.124533 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:21.125838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-598e673d-badf-43e7-9cea-334c3d00d9a8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.235413 Jan 19 01:06:21.127207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 520/1084] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:20 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:22.148384 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:22.149006 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:22.160834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:22.161881 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:22.163068 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:22.163853 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:22.354575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:22.365525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:22.367512 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:22.368899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3cf25acf-826d-4477-9820-68b119a60b8f tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.227221 Jan 19 01:06:22.373728 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 565/1085] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:22 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:23.387876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:23.389369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:23.397950 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:23.398447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:23.399563 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:23.400022 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:23.565627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:23.573761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:23.575104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:23.576426 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b958eb2e-225f-4371-806f-f02ecc50ebe6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.192390 Jan 19 01:06:23.577006 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 521/1086] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:23 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:24.598948 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:24.600370 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:24.609301 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:24.610173 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:24.611288 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:24.611737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:24.799921 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:24.808546 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:24.810105 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:24.811314 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-45baf0e1-73b8-4780-8e0c-171505da02e0 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.218074 Jan 19 01:06:24.811886 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 566/1087] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:24 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:25.830490 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:25.831178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:25.838715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:25.839181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:25.840440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:25.841151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:26.049852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:26.059309 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:26.060838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:26.062067 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-16359b33-c750-4717-baf2-1b0566e9a13e tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.235389 Jan 19 01:06:26.062670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 522/1088] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:25 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:27.080336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:27.081063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:27.087896 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:27.088357 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:27.089168 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:27.089647 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:27.234407 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:27.243111 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:27.244605 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:27.245806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2bfaa719-a9cf-404d-b380-c87c26ac8f67 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.169327 Jan 19 01:06:27.246382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 567/1089] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:27 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:28.264444 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:28.265181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:28.272643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:28.273510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:28.273915 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:28.274352 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:28.431317 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:28.440527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:28.442238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:28.443634 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5e55cdb1-a21c-4adb-976a-6a3c6eac5e93 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.182900 Jan 19 01:06:28.444320 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 523/1090] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:28 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:29.462032 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:29.462671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:29.469308 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:29.469801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:29.470664 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:29.471110 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:29.610644 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:29.619609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:29.621133 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:29.622570 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3e97230c-3ef0-4a71-98d5-b9869204fc28 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.164256 Jan 19 01:06:29.623150 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 568/1091] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:29 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:30.643374 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:30.644151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:30.652086 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:30.652761 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:30.653833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:30.654580 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:30.842156 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:30.851884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:30.853513 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:30.854929 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-91d1f2e3-88f5-4fbb-ae22-262434615131 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.217113 Jan 19 01:06:30.855589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 524/1092] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:30 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:31.873615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:31.874424 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:31.882740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:31.883339 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:31.884436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:31.885000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:32.053525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:32.062438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:32.064002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:32.065203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-82857828-8463-4045-8519-c5b7ad47db90 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.195466 Jan 19 01:06:32.065826 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 569/1093] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:31 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:33.083471 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:33.084089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:33.090819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:33.091096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:33.091787 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:33.092300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:33.260411 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:33.269188 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:33.270826 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:33.272295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0a74cc45-fdbf-4dfa-b794-74aa9aaaa5c7 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.192669 Jan 19 01:06:33.272869 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 525/1094] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:33 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:34.301907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:34.302551 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:34.309758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:34.310305 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:34.311050 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:34.311839 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:34.497520 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:34.527193 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:34.529098 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:34.531271 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b691948b-02cd-4db1-935a-1752c3a7ecfe tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.234384 Jan 19 01:06:34.532210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 570/1095] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:34 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:34.655162 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-a891227f-ddc8-4a97-9676-3d0a66976de7 req-bbc8edf1-20df-43f4-9b3c-0ce87554b549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "name": "network-vif-plugged", "status": "completed", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:06:34.660140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:06:34.660140 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:06:34.671935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-a891227f-ddc8-4a97-9676-3d0a66976de7 req-bbc8edf1-20df-43f4-9b3c-0ce87554b549 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:34.672387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-a891227f-ddc8-4a97-9676-3d0a66976de7 req-bbc8edf1-20df-43f4-9b3c-0ce87554b549 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:34.686489 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-a891227f-ddc8-4a97-9676-3d0a66976de7 req-bbc8edf1-20df-43f4-9b3c-0ce87554b549 service nova] Creating event network-vif-plugged:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:06:34.692343 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-a891227f-ddc8-4a97-9676-3d0a66976de7 req-bbc8edf1-20df-43f4-9b3c-0ce87554b549 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045393 Jan 19 01:06:34.693845 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 526/1096] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:06:35.550947 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:35.551571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:35.558295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:35.558782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:35.559715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:35.560210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:35.708203 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:35.716418 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:35.718000 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:35.719237 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b2dbc209-1088-4bd6-bec9-26026b48e67b tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.172929 Jan 19 01:06:35.719869 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 571/1097] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:35 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:06:36.746554 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:36.748437 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:36.765873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:36.766330 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:36.767228 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:36.767715 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:36.950590 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:36.959939 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:36.963669 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:36.966791 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f107580f-0c7e-4a0d-8a43-621048db8ce8 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1731 microversion: 2.20 time: 0.231818 Jan 19 01:06:36.968314 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 527/1098] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:36 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:06:37.990118 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:06:37.990817 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:06:37.997369 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:37.997862 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:37.998707 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:06:37.999077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:06:38.147571 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:38.157522 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:38.159066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:06:38.160254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7dfe7750-793b-4f09-99ab-acd94b842095 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1718 microversion: 2.20 time: 0.173816 Jan 19 01:06:38.160824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 572/1099] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:06:37 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:07:03.305689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-631190551", "imageRef": "0d475634-530e-4420-a838-d01aa5710e7e", "flavorRef": "452"}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:03.353587 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] validate_networks() for None {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:07:03.621873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:07:03.622297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:07:03.622768 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:07:03.623173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:07:03.623586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:07:03.632384 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:03.632834 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:03.633677 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:03.634120 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:03.650922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Getting quotas for project 86364b7a706c430d93681e2f320fe74d. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:07:03.654758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Getting quotas for user 56ad83d1fcd14260b3895cbff541c90e and project 86364b7a706c430d93681e2f320fe74d. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:07:03.665800 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:07:03.668066 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d475634-530e-4420-a838-d01aa5710e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:07:03.711515 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-913ae49e-9ad5-49ea-be18-a3409fceaac5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.409554 Jan 19 01:07:03.712155 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 528/1100] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:07:03.722972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-39714ebe-375f-419d-abd5-e4e10ff0b5c5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:03.723674 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-39714ebe-375f-419d-abd5-e4e10ff0b5c5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:03.780383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-39714ebe-375f-419d-abd5-e4e10ff0b5c5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:03.793678 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-39714ebe-375f-419d-abd5-e4e10ff0b5c5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1214 microversion: 2.1 time: 0.074772 Jan 19 01:07:03.794829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 573/1101] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:03 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:04.818169 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:04.818801 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:04.825018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:04.825472 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:04.826287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:04.826728 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:04.891518 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:04.900236 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-69c75d39-1270-491c-967b-6942a50f7ee3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1274 microversion: 2.1 time: 0.086311 Jan 19 01:07:04.900841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 529/1102] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:04 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:05.920420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:05.920420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:05.930807 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:05.931447 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:05.932366 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:05.933120 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:06.194699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:06.203183 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5739abaf-e979-46f2-a810-002a41739b6f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.288190 Jan 19 01:07:06.203936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 574/1103] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:05 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:06.610860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-7fb65abd-35de-4c60-ab0d-fbf9b1c682fe req-330657cf-27bd-498c-9639-e95592e1b846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb852782-3419-467e-b8fa-baa72c2c926f", "tag": "e5051570-f6c0-45dc-a293-9571a086a20a"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:06.614151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:06.614151 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:07:06.628475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-7fb65abd-35de-4c60-ab0d-fbf9b1c682fe req-330657cf-27bd-498c-9639-e95592e1b846 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:06.629275 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-7fb65abd-35de-4c60-ab0d-fbf9b1c682fe req-330657cf-27bd-498c-9639-e95592e1b846 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:06.660371 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-7fb65abd-35de-4c60-ab0d-fbf9b1c682fe req-330657cf-27bd-498c-9639-e95592e1b846 service nova] Creating event network-changed:e5051570-f6c0-45dc-a293-9571a086a20a for instance eb852782-3419-467e-b8fa-baa72c2c926f on hv-cinder-79987 Jan 19 01:07:06.668315 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-7fb65abd-35de-4c60-ab0d-fbf9b1c682fe req-330657cf-27bd-498c-9639-e95592e1b846 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064520 Jan 19 01:07:06.669291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 530/1104] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:07.225354 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:07.226563 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:07.235562 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:07.236989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:07.238060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:07.238570 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:07.511285 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:07.519835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d64ce4f8-4cca-449e-8333-b2713e4e2ed4 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.302065 Jan 19 01:07:07.520438 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 575/1105] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:07 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:08.542056 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:08.542686 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:08.550191 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:08.550651 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:08.551469 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:08.551910 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:08.715889 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:08.724327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c6e30f98-7989-4939-ba25-dc1545e87028 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.186870 Jan 19 01:07:08.724934 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 531/1106] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:08 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:09.741464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:09.742525 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:09.749337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:09.749848 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:09.750640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:09.751095 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:09.905080 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:09.914953 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-0a77e1c9-b2db-4aba-b45c-a2d43234af96 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.177159 Jan 19 01:07:09.915670 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 576/1107] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:09 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:10.932663 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:10.933278 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:10.940555 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:10.941008 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:10.941846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:10.942295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.052013 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:11.053075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:11.063813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.065136 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.066296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.066827 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.100210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:11.108267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-255f6a49-8f3e-4ce9-9acb-81f55f22f63f tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.179268 Jan 19 01:07:11.108872 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 532/1108] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:10 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:11.115893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1c330a75-9dd7-4688-95e9-7753bcd4f460 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070699 Jan 19 01:07:11.116986 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 577/1109] 10.222.0.35 () {60 vars in 1342 bytes} [Wed Jan 19 01:07:11 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:07:11.178758 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:11.179327 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:11.188505 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.189887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.191453 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.192207 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.227045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:07:11.335063 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d9436448-163c-4a13-b7f5-37f52f170790 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 204 len: 0 microversion: 2.20 time: 0.159749 Jan 19 01:07:11.336161 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 533/1110] 10.222.0.35 () {60 vars in 1279 bytes} [Wed Jan 19 01:07:11 2022] DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 01:07:11.348082 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:11.349230 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:11.359395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.360206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.362307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:11.363047 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:11.545210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:11.558372 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:11.559916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:11.561253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-4b3bc071-174c-48e1-8d66-602a68f7495a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.220454 Jan 19 01:07:11.561949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 578/1111] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:11 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 01:07:12.126610 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:12.127577 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:12.134746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:12.135211 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:12.136032 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:12.136479 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:12.281971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:12.301281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-5a478b48-8eec-4de9-9ea4-af25d82693d5 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.178277 Jan 19 01:07:12.302431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 534/1112] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:12 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:07:12.586808 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:12.587534 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:12.593982 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:12.594420 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:12.595758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:12.596204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:12.746583 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:12.755810 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:12.757353 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:12.758638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8ea60d47-447d-4fc0-afc3-4539ef98bd41 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1724 microversion: 2.20 time: 0.175704 Jan 19 01:07:12.759269 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 579/1113] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:12 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:07:12.831542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-fea592db-8118-4175-8a55-0949daaedd74 req-fe4d2025-1c81-4c55-bb7b-940e2d6f2487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb852782-3419-467e-b8fa-baa72c2c926f", "name": "network-vif-plugged", "status": "completed", "tag": "e5051570-f6c0-45dc-a293-9571a086a20a"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:12.834825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:12.834825 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:07:12.850295 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-fea592db-8118-4175-8a55-0949daaedd74 req-fe4d2025-1c81-4c55-bb7b-940e2d6f2487 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:12.851091 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-fea592db-8118-4175-8a55-0949daaedd74 req-fe4d2025-1c81-4c55-bb7b-940e2d6f2487 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:12.872508 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-fea592db-8118-4175-8a55-0949daaedd74 req-fe4d2025-1c81-4c55-bb7b-940e2d6f2487 service nova] Creating event network-vif-plugged:e5051570-f6c0-45dc-a293-9571a086a20a for instance eb852782-3419-467e-b8fa-baa72c2c926f on hv-cinder-79987 Jan 19 01:07:12.880799 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-fea592db-8118-4175-8a55-0949daaedd74 req-fe4d2025-1c81-4c55-bb7b-940e2d6f2487 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056768 Jan 19 01:07:12.881844 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 535/1114] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:13.318959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:13.319608 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:13.326288 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:13.326749 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:13.327553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:13.327998 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:13.618502 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:13.626170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3642bba5-4ecb-40df-a04b-5bcd21c34401 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1314 microversion: 2.1 time: 0.310872 Jan 19 01:07:13.631514 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 580/1115] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:13 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:13.787384 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:13.788108 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:13.796076 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:13.796545 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:13.797376 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:13.797859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:13.875431 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:13.886127 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:13.887793 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:13.889388 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-0e9e0fd4-eb0f-4f70-a596-b959d3513d7a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1657 microversion: 2.20 time: 0.107170 Jan 19 01:07:13.889995 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 536/1116] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:13 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:07:14.414830 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-42fa8275-febd-400e-bd05-a0b86776c6c0 req-a280ee6c-fc12-40d9-8841-a03d95411bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efcf53c-ea61-4e06-851f-f661dff08fab", "name": "network-vif-deleted", "tag": "e871ea0f-3e5b-4940-afab-68479d0962ba"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:14.416701 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:14.416701 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:07:14.428334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-42fa8275-febd-400e-bd05-a0b86776c6c0 req-a280ee6c-fc12-40d9-8841-a03d95411bc4 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.428818 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-42fa8275-febd-400e-bd05-a0b86776c6c0 req-a280ee6c-fc12-40d9-8841-a03d95411bc4 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.443802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-42fa8275-febd-400e-bd05-a0b86776c6c0 req-a280ee6c-fc12-40d9-8841-a03d95411bc4 service nova] Creating event network-vif-deleted:e871ea0f-3e5b-4940-afab-68479d0962ba for instance 4efcf53c-ea61-4e06-851f-f661dff08fab on hv-cinder-79987 Jan 19 01:07:14.450222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-42fa8275-febd-400e-bd05-a0b86776c6c0 req-a280ee6c-fc12-40d9-8841-a03d95411bc4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038968 Jan 19 01:07:14.450773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 581/1117] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:14.644522 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:14.645481 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:14.653638 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.654418 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.655804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.656747 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.857673 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:14.866520 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-2f1319c1-b5ca-4594-89f4-dbc3831a125b tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1464 microversion: 2.1 time: 0.227115 Jan 19 01:07:14.867135 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 537/1118] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:14 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:14.907816 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:14.908598 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:14.908832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:14.910494 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:14.916448 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.917288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.918496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.918989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.919182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.919921 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.920097 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.920487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.951186 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:07:14.960124 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:14.960570 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:14.961034 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.objects.instance [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lazy-loading 'fault' on Instance uuid 4efcf53c-ea61-4e06-851f-f661dff08fab {{(pid=116543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:07:15.065944 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-647b2aea-b955-4991-b977-ea193aab344e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 204 len: 0 microversion: 2.1 time: 0.161217 Jan 19 01:07:15.066471 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 582/1119] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:07:14 2022] DELETE /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:07:15.075710 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:15.076430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:15.085350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:15.086138 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:15.087044 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:15.087545 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:15.309621 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:15.319166 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-2ec6101f-0820-40d8-9eba-7bae90026c4e tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1470 microversion: 2.1 time: 0.247663 Jan 19 01:07:15.319668 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 583/1120] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:15 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:07:15.382584 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:15.396046 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:15.398763 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa32be6bac74509963e42686fbab16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e726f093b7418db87497cfb659dbf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:15.400506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-305a2977-fbe1-4794-9f38-8f1ade75b2bf tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 200 len: 1371 microversion: 2.20 time: 0.496352 Jan 19 01:07:15.401499 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 538/1121] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:14 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 01:07:16.339187 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:16.339806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:16.346312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:16.346776 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:16.347564 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:16.348008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:16.419887 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:16.420509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:16.427851 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:16.428300 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:16.429095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:16.429540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:16.444691 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. Jan 19 01:07:16.445281 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:16.446143 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-8b81fadc-77b0-4204-904c-7ee4beb7995d tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 404 len: 111 microversion: 2.20 time: 0.030055 Jan 19 01:07:16.446695 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 539/1122] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:16 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 19 01:07:16.454594 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3635603a-e758-47a8-9610-e3e2ff53741a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '.version_select at 0x7f934c653790>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:16.457991 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3635603a-e758-47a8-9610-e3e2ff53741a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [02b23756-3575-4467-822c-4993ace4e0eb] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 01:07:16.482849 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:16.490683 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8d2b2343-e7ac-44fd-af9b-065876a92fb3 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1470 microversion: 2.1 time: 0.155207 Jan 19 01:07:16.491247 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 584/1123] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:16 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:17.205466 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-03d6f15e-f2df-4383-b0e1-bfc71f358c4e req-d5744496-cc52-4d99-8713-73c4b7124d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb852782-3419-467e-b8fa-baa72c2c926f", "name": "network-vif-deleted", "tag": "e5051570-f6c0-45dc-a293-9571a086a20a"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:17.207260 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:17.207260 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:07:17.214709 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-03d6f15e-f2df-4383-b0e1-bfc71f358c4e req-d5744496-cc52-4d99-8713-73c4b7124d6d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:17.215096 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-03d6f15e-f2df-4383-b0e1-bfc71f358c4e req-d5744496-cc52-4d99-8713-73c4b7124d6d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:17.227128 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-03d6f15e-f2df-4383-b0e1-bfc71f358c4e req-d5744496-cc52-4d99-8713-73c4b7124d6d service nova] Creating event network-vif-deleted:e5051570-f6c0-45dc-a293-9571a086a20a for instance eb852782-3419-467e-b8fa-baa72c2c926f on hv-cinder-79987 Jan 19 01:07:17.232408 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-03d6f15e-f2df-4383-b0e1-bfc71f358c4e req-d5744496-cc52-4d99-8713-73c4b7124d6d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 Jan 19 01:07:17.233278 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 585/1124] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:07:17.465495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [None req-3635603a-e758-47a8-9610-e3e2ff53741a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [02b23756-3575-4467-822c-4993ace4e0eb] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 40688. Jan 19 01:07:17.484846 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3635603a-e758-47a8-9610-e3e2ff53741a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577432436" status: 204 len: 0 microversion: 2.20 time: 1.033668 Jan 19 01:07:17.485435 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 540/1125] 10.222.0.35 () {60 vars in 1258 bytes} [Wed Jan 19 01:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577432436 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 19 01:07:17.508539 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:17.509382 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:17.515584 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:17.516067 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:17.517373 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:17.517863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:17.548615 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:17.549107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:17.549858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lazy-loading 'fault' on Instance uuid eb852782-3419-467e-b8fa-baa72c2c926f {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:07:17.600296 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ad83d1fcd14260b3895cbff541c90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86364b7a706c430d93681e2f320fe74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:17.607566 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-61ab6d54-0a36-4b52-bb3b-c5eaaee03e27 tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 200 len: 1304 microversion: 2.1 time: 0.103478 Jan 19 01:07:17.608145 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 586/1126] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:17 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:18.624474 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:18.625239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] [instance: eb852782-3419-467e-b8fa-baa72c2c926f] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:18.631819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:18.632271 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:18.633048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:18.633489 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:18.646301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] HTTP exception thrown: Instance eb852782-3419-467e-b8fa-baa72c2c926f could not be found. Jan 19 01:07:18.646886 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] Returning 404 to user: Instance eb852782-3419-467e-b8fa-baa72c2c926f could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:18.647700 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-bc4957d5-6d2d-4cb9-ab4a-f75481577c6c tempest-VolumesNegativeTest-1314202290 tempest-VolumesNegativeTest-1314202290-project] 10.222.0.35 "GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f" status: 404 len: 111 microversion: 2.1 time: 0.027403 Jan 19 01:07:18.648223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 541/1127] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:18 2022] GET /compute/v2.1/servers/eb852782-3419-467e-b8fa-baa72c2c926f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:07:19.275882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:19.276392 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:19.283250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:19.283715 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:19.284526 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:19.284962 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:19.301393 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. Jan 19 01:07:19.302093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:19.302990 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f3fa87e2-e42b-41f4-bf63-faa36214b4d6 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 404 len: 111 microversion: 2.20 time: 0.031288 Jan 19 01:07:19.303626 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 587/1128] 10.222.0.35 () {60 vars in 1279 bytes} [Wed Jan 19 01:07:19 2022] DELETE /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:07:19.311340 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:19.311935 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: 4efcf53c-ea61-4e06-851f-f661dff08fab] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:19.318898 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:19.319360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:19.320150 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:19.320593 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:19.334171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. Jan 19 01:07:19.334793 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance 4efcf53c-ea61-4e06-851f-f661dff08fab could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:19.335617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-03bbaf4c-f964-485f-9574-bb593271636a tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab" status: 404 len: 111 microversion: 2.20 time: 0.027999 Jan 19 01:07:19.336149 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 542/1129] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:19 2022] GET /compute/v2.1/servers/4efcf53c-ea61-4e06-851f-f661dff08fab => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:07:20.467216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:20.467908 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:20.475721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:20.476223 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:20.477035 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:20.477496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:20.491740 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. Jan 19 01:07:20.492334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:20.493200 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-6ed31352-9d19-4000-a73e-b0bbd1b9e4e5 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 404 len: 111 microversion: 2.20 time: 0.029951 Jan 19 01:07:20.493742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 588/1130] 10.222.0.35 () {60 vars in 1279 bytes} [Wed Jan 19 01:07:20 2022] DELETE /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:07:20.503081 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:20.503698 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] [instance: fdb95a1c-6e71-42df-9009-f72ff6c3b21b] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:20.509909 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:20.511657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:20.511657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:20.511657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:20.526710 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] HTTP exception thrown: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. Jan 19 01:07:20.527454 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] Returning 404 to user: Instance fdb95a1c-6e71-42df-9009-f72ff6c3b21b could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:20.528301 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-02f41109-2c13-4855-973b-a173c811c301 tempest-AttachVolumeShelveTestJSON-2141516294 tempest-AttachVolumeShelveTestJSON-2141516294-project] 10.222.0.35 "GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b" status: 404 len: 111 microversion: 2.20 time: 0.029678 Jan 19 01:07:20.529042 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 543/1131] 10.222.0.35 () {60 vars in 1276 bytes} [Wed Jan 19 01:07:20 2022] GET /compute/v2.1/servers/fdb95a1c-6e71-42df-9009-f72ff6c3b21b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 01:07:24.841257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:24.842478 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:24.849600 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:24.849805 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-d66485b4-40ef-42dd-9b44-f6f331ecefe6 req-ef56ce1a-e791-4241-917b-fe0b2d6bec1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:24.850846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:24.851922 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:24.853147 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:24.856888 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:24.856888 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:07:24.871061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d66485b4-40ef-42dd-9b44-f6f331ecefe6 req-ef56ce1a-e791-4241-917b-fe0b2d6bec1f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:24.871956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d66485b4-40ef-42dd-9b44-f6f331ecefe6 req-ef56ce1a-e791-4241-917b-fe0b2d6bec1f service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:24.901126 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:07:24.913597 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-d66485b4-40ef-42dd-9b44-f6f331ecefe6 req-ef56ce1a-e791-4241-917b-fe0b2d6bec1f service nova] Creating event network-changed:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:07:24.925146 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-d66485b4-40ef-42dd-9b44-f6f331ecefe6 req-ef56ce1a-e791-4241-917b-fe0b2d6bec1f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079560 Jan 19 01:07:24.927104 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 544/1132] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:25.050231 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-84358d49-70bc-4c76-9cc9-a49f6e0273a3 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 204 len: 0 microversion: 2.1 time: 0.210880 Jan 19 01:07:25.051178 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 589/1133] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:07:24 2022] DELETE /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:07:25.062657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:25.064838 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:25.073123 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:25.074847 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:25.075879 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:25.076316 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:25.278318 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:25.291213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7d72d861-3147-46f2-87be-083123ea5bf5 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1566 microversion: 2.1 time: 0.234595 Jan 19 01:07:25.291808 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 545/1134] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:25 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:26.309337 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:26.309993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:26.316975 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:26.317428 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:26.318233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:26.318669 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:26.471132 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:26.478625 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-617490bd-4007-48a2-87ec-0fb71ae4c805 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1448 microversion: 2.1 time: 0.173430 Jan 19 01:07:26.479197 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 590/1135] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:26 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:27.497148 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:27.497958 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:27.504993 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:27.505484 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:27.506303 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:27.506931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:27.574286 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-0026f7bb-5dc6-4c2d-96cf-0cac5f1bb7d3 req-45125428-5634-404c-b22f-a5aa3bde4b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ef89b-e99e-4b9f-87ac-7d61514ee527", "name": "network-vif-deleted", "tag": "8bcb40e7-111c-4118-8b6c-384b4e2fd7e5"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:27.574742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbc6d028bae4706b508e2e5580506d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fc118391b34d35b75c25f76155c402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:07:27.576218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:07:27.576218 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:07:27.584252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-fc6f05d4-9473-44be-af1a-3ff5b06179cb tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 200 len: 1381 microversion: 2.1 time: 0.091247 Jan 19 01:07:27.584860 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 546/1136] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:27 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 1381 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:27.585439 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0026f7bb-5dc6-4c2d-96cf-0cac5f1bb7d3 req-45125428-5634-404c-b22f-a5aa3bde4b60 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:27.585916 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-0026f7bb-5dc6-4c2d-96cf-0cac5f1bb7d3 req-45125428-5634-404c-b22f-a5aa3bde4b60 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:27.598216 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-0026f7bb-5dc6-4c2d-96cf-0cac5f1bb7d3 req-45125428-5634-404c-b22f-a5aa3bde4b60 service nova] Creating event network-vif-deleted:8bcb40e7-111c-4118-8b6c-384b4e2fd7e5 for instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 on hv-cinder-79987 Jan 19 01:07:27.603582 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-0026f7bb-5dc6-4c2d-96cf-0cac5f1bb7d3 req-45125428-5634-404c-b22f-a5aa3bde4b60 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Jan 19 01:07:27.604204 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 591/1137] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:27.776900 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1e35c231-f312-4412-859e-967712810dad tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c5bab80>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:27.824198 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1e35c231-f312-4412-859e-967712810dad tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2537e0ac-a42c-431d-9d33-c8aa00c0bb1a" status: 200 len: 350 microversion: 2.1 time: 0.050848 Jan 19 01:07:27.824777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 547/1138] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:07:27 2022] GET /compute/v2.1/os-volumes/2537e0ac-a42c-431d-9d33-c8aa00c0bb1a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:28.602988 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:28.603814 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] [instance: 8d9ef89b-e99e-4b9f-87ac-7d61514ee527] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:07:28.611298 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:28.611727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:28.612550 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:07:28.612972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:07:28.628691 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] HTTP exception thrown: Instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 could not be found. Jan 19 01:07:28.629295 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Returning 404 to user: Instance 8d9ef89b-e99e-4b9f-87ac-7d61514ee527 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:07:28.630181 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d6a41429-aebd-4167-b0c0-696805e66e83 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527" status: 404 len: 111 microversion: 2.1 time: 0.032369 Jan 19 01:07:28.631119 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 592/1139] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:07:28 2022] GET /compute/v2.1/servers/8d9ef89b-e99e-4b9f-87ac-7d61514ee527 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:07:28.803334 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b357c291-bdca-4a00-b387-be3806111b06 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] Calling method '.version_select at 0x7f934c63d160>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:28.831316 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b357c291-bdca-4a00-b387-be3806111b06 tempest-TestShelveInstance-876803215 tempest-TestShelveInstance-876803215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1638542336" status: 202 len: 0 microversion: 2.1 time: 0.033203 Jan 19 01:07:28.831918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 548/1140] 10.222.0.35 () {58 vars in 1253 bytes} [Wed Jan 19 01:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1638542336 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:07:29.182787 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-beca2262-a84c-48e3-8b59-b38a7d3c07ef tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c7b8670>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:29.232328 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-beca2262-a84c-48e3-8b59-b38a7d3c07ef tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30aa9985-7f8d-41bf-815d-2420ce1ba67f" status: 200 len: 351 microversion: 2.1 time: 0.052823 Jan 19 01:07:29.232905 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 593/1141] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:07:29 2022] GET /compute/v2.1/os-volumes/30aa9985-7f8d-41bf-815d-2420ce1ba67f => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:30.591166 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-7218806e-9ebe-4a40-9e05-ac23533e118a tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c653040>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:30.643697 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-7218806e-9ebe-4a40-9e05-ac23533e118a tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/f9e8f300-8653-4660-9bae-56b9df40e5db" status: 200 len: 351 microversion: 2.1 time: 0.060272 Jan 19 01:07:30.644288 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 549/1142] 10.222.0.35 () {58 vars in 1244 bytes} [Wed Jan 19 01:07:30 2022] GET /compute/v2.1/os-volumes/f9e8f300-8653-4660-9bae-56b9df40e5db => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:30.659699 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-7bde79ee-9d95-4955-9110-4e9a1711b664 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c7b0e50>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:30.760949 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-7bde79ee-9d95-4955-9110-4e9a1711b664 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107014 Jan 19 01:07:30.761535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 594/1143] 10.222.0.35 () {58 vars in 1133 bytes} [Wed Jan 19 01:07:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:30.775624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-812501ee-8942-4e68-996d-ddfe19db9295 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c6723a0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:30.859538 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-812501ee-8942-4e68-996d-ddfe19db9295 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087548 Jan 19 01:07:30.860336 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 550/1144] 10.222.0.35 () {58 vars in 1148 bytes} [Wed Jan 19 01:07:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:07:30.872174 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-73abb4ac-2961-4ceb-ba51-2fda210f0486 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c7b0d30>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:30.964692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-73abb4ac-2961-4ceb-ba51-2fda210f0486 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095888 Jan 19 01:07:30.965714 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 595/1145] 10.222.0.35 () {58 vars in 1133 bytes} [Wed Jan 19 01:07:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:07:30.979559 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e8e6acce-2743-437f-aa4d-517bcc46c051 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c62e670>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:31.085507 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e8e6acce-2743-437f-aa4d-517bcc46c051 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.109537 Jan 19 01:07:31.086421 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 551/1146] 10.222.0.35 () {58 vars in 1166 bytes} [Wed Jan 19 01:07:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:07:31.098561 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-11f1173e-b6de-479a-b060-df6cc07bbcb6 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f9351232040>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:31.184385 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-11f1173e-b6de-479a-b060-df6cc07bbcb6 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090263 Jan 19 01:07:31.187417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 596/1147] 10.222.0.35 () {58 vars in 1169 bytes} [Wed Jan 19 01:07:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:07:31.197736 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-a11f2bff-6c5f-490b-9ca4-11589dece561 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c5cb4c0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:31.341071 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-a11f2bff-6c5f-490b-9ca4-11589dece561 tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.147159 Jan 19 01:07:31.349703 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 552/1148] 10.222.0.35 () {58 vars in 1154 bytes} [Wed Jan 19 01:07:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:31.354060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ea2f1241-794d-4ec8-a9bf-662e3930c8cd tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c7e0160>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:31.460899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ea2f1241-794d-4ec8-a9bf-662e3930c8cd tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110691 Jan 19 01:07:31.461725 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 597/1149] 10.222.0.35 () {58 vars in 1187 bytes} [Wed Jan 19 01:07:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:07:31.476797 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-f67c850d-31f7-4bd7-816a-84c8c39b0cff tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] Calling method '.version_select at 0x7f934c6724c0>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:07:31.645029 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-f67c850d-31f7-4bd7-816a-84c8c39b0cff tempest-VolumesTestJSON-1751830045 tempest-VolumesTestJSON-1751830045-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.172121 Jan 19 01:07:31.645734 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 553/1150] 10.222.0.35 () {58 vars in 1154 bytes} [Wed Jan 19 01:07:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:07:47.930350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Action: 'create', calling method: .version_select at 0x7f934c88c0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1931878432"}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:07:47.944892 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for project 8e01579e07bf4fb4b649e597de305f47. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:07:47.950482 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for user ca33b346a78845b7a859638cff3e6277 and project 8e01579e07bf4fb4b649e597de305f47. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:07:48.107879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for project 8e01579e07bf4fb4b649e597de305f47. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:07:48.112172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for user ca33b346a78845b7a859638cff3e6277 and project 8e01579e07bf4fb4b649e597de305f47. Resources: {'key_pairs'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:07:48.127553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-49fc8d1b-e0a0-46c5-a6e4-abfa72e16980 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.393573 Jan 19 01:07:48.128161 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 598/1151] 10.222.0.35 () {60 vars in 1157 bytes} [Wed Jan 19 01:07:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:08:06.876804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-57471053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931878432", "security_groups": [{"name": "tempest-secgroup-smoke-1242295534"}], "block_device_mapping_v2": [{"uuid": "e71a412f-f9a0-46c2-8dc6-233032b4e5f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb720cae-4dad-4da6-a242-4f7886e697d6"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:08:06.994788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] validate_networks() for [('bb720cae-4dad-4da6-a242-4f7886e697d6', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:08:07.644960 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:08:07.645947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:08:07.645947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:08:07.646297 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:08:07.646714 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:08:07.655794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:07.656247 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:07.657068 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:07.657509 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:07.675705 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:08:07.679901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for user ca33b346a78845b7a859638cff3e6277 and project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:08:07.741874 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:08:07.744184 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e71a412f-f9a0-46c2-8dc6-233032b4e5f6',volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:08:07.890527 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-43ef05a8-a479-4e5d-aa2e-e9d1181b3e8f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.017923 Jan 19 01:08:07.891922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 554/1152] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:08:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:08:07.902899 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5855790c-0110-4697-9562-8ff1b525554a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:07.903495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5855790c-0110-4697-9562-8ff1b525554a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:07.960063 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-5855790c-0110-4697-9562-8ff1b525554a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:07.967053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5855790c-0110-4697-9562-8ff1b525554a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1093 microversion: 2.1 time: 0.068414 Jan 19 01:08:07.967643 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 599/1153] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:07 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:08:08.984973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:08.985746 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:08.996589 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:08.997050 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:08.998138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:08.998586 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:09.073922 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:09.092362 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-847f6b21-73c4-4e1c-bc04-63e379bf1e17 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1199 microversion: 2.1 time: 0.106988 Jan 19 01:08:09.101023 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 555/1154] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:08 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:08:10.107678 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:10.108435 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:10.115363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:10.115893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:10.117028 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:10.117519 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:10.364835 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:10.372750 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d1621566-ec04-49e6-9da8-95356289f032 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.268736 Jan 19 01:08:10.373346 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 600/1155] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:10 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:10.506089 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-2eb3aa57-25ff-41a3-a8f7-4cad5cb1fd66 req-32b0d5e7-5f6a-40bf-b0bd-e7b85346b1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecd3e47-774a-4da3-b470-3012545d8b69", "tag": "ea54a915-7d54-4b44-9b45-f5261234d2b2"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:08:10.507657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:08:10.507657 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:08:10.514944 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-2eb3aa57-25ff-41a3-a8f7-4cad5cb1fd66 req-32b0d5e7-5f6a-40bf-b0bd-e7b85346b1d6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:10.515400 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-2eb3aa57-25ff-41a3-a8f7-4cad5cb1fd66 req-32b0d5e7-5f6a-40bf-b0bd-e7b85346b1d6 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:10.530664 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-2eb3aa57-25ff-41a3-a8f7-4cad5cb1fd66 req-32b0d5e7-5f6a-40bf-b0bd-e7b85346b1d6 service nova] Creating event network-changed:ea54a915-7d54-4b44-9b45-f5261234d2b2 for instance aecd3e47-774a-4da3-b470-3012545d8b69 on hv-cinder-79987 Jan 19 01:08:10.536945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-2eb3aa57-25ff-41a3-a8f7-4cad5cb1fd66 req-32b0d5e7-5f6a-40bf-b0bd-e7b85346b1d6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 Jan 19 01:08:10.537593 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 556/1156] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:08:11.397663 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:11.398395 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:11.405614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:11.406206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:11.407094 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:11.407802 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:11.686248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:11.694821 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-92e5942b-2e82-49f8-80bd-48a7320f8a16 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.303403 Jan 19 01:08:11.695425 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 601/1157] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:11 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:12.713643 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:12.714338 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:12.720602 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:12.721054 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:12.722477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:12.722918 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:12.859804 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:12.867231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6fd46406-9ae7-4634-b2cd-70784c575e96 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.158027 Jan 19 01:08:12.867810 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 557/1158] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:12 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:08:13.884092 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:13.884760 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:13.890741 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:13.891205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:13.891996 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:13.892446 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:14.026442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:14.033727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-eae80adc-36f6-4ded-92ec-364e28b0a158 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.153456 Jan 19 01:08:14.034907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 602/1159] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:13 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:15.050954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:15.051624 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:15.057786 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:15.058238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:15.059027 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:15.059462 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:15.195331 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:15.203045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b26f9fa9-c3c9-4378-90fa-fb41e0bd0537 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.156302 Jan 19 01:08:15.203678 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 558/1160] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:15 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:16.220238 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:16.220880 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:16.227920 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:16.228374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:16.229168 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:16.229638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:16.366736 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:16.374072 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-a095168b-6a23-4003-a44f-16083ff5a0ca tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.157410 Jan 19 01:08:16.374652 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 603/1161] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:16 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:17.390780 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:17.391405 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:17.397788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:17.398239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:17.399020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:17.399461 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:17.541964 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:17.550447 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-3e38db35-b667-4ec8-a7f3-69e70c3af25f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.162670 Jan 19 01:08:17.551044 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 559/1162] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:17 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:18.567973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:18.568521 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:18.574973 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:18.575421 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:18.576211 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:18.576651 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:18.710825 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:18.718310 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-f9b06694-d8d9-41e7-94c1-afd4160ef7cb tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.154698 Jan 19 01:08:18.718893 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 604/1163] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:18 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:19.735238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:19.735859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:19.743920 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:19.744372 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:19.745181 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:19.745640 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:19.892361 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:19.902146 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-052e01a2-8713-488a-ae0e-d50370659da0 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.170407 Jan 19 01:08:19.902752 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 560/1164] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:19 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:20.920519 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:20.921228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:20.928275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:20.928733 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:20.929531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:20.930014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:21.068746 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:21.076379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1de41157-c7f1-4fbc-8ec1-cd97b7dfe4e3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.160590 Jan 19 01:08:21.076960 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 605/1165] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:20 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:21.817239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-07cc8199-2b16-444a-aeea-21cca26070e2 req-710d84ba-d8c4-4325-929d-03a2ca0e4bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecd3e47-774a-4da3-b470-3012545d8b69", "name": "network-vif-plugged", "status": "completed", "tag": "ea54a915-7d54-4b44-9b45-f5261234d2b2"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:08:21.818833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:08:21.818833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:08:21.826210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-07cc8199-2b16-444a-aeea-21cca26070e2 req-710d84ba-d8c4-4325-929d-03a2ca0e4bb8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:21.826794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-07cc8199-2b16-444a-aeea-21cca26070e2 req-710d84ba-d8c4-4325-929d-03a2ca0e4bb8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:21.838037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-07cc8199-2b16-444a-aeea-21cca26070e2 req-710d84ba-d8c4-4325-929d-03a2ca0e4bb8 service nova] Creating event network-vif-plugged:ea54a915-7d54-4b44-9b45-f5261234d2b2 for instance aecd3e47-774a-4da3-b470-3012545d8b69 on hv-cinder-79987 Jan 19 01:08:21.842975 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-07cc8199-2b16-444a-aeea-21cca26070e2 req-710d84ba-d8c4-4325-929d-03a2ca0e4bb8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029372 Jan 19 01:08:21.843572 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 561/1166] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:08:22.097700 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:22.098321 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:22.104732 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:22.105198 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:22.106046 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:22.106491 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:22.270856 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:22.279206 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-aee3926a-6bde-462e-85b0-95492a5dd179 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.185645 Jan 19 01:08:22.279720 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 606/1167] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:22 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:23.297517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:23.298239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:23.306345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:23.306345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:23.307233 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:23.307776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:23.455698 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:23.468460 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-6d8a1b0a-1a69-4ed5-a7e1-224ef2c02f4e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1265 microversion: 2.1 time: 0.175322 Jan 19 01:08:23.469045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 562/1168] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:23 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:24.486879 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:24.487510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:24.494341 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:24.494801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:24.495614 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:24.496053 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:24.632487 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:24.639778 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-43284a11-7389-4190-8f12-f34a644509f1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1451 microversion: 2.1 time: 0.157689 Jan 19 01:08:24.640342 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 607/1169] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:24 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:24.655563 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:08:24.656178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:08:24.662399 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:24.662852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:24.663679 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:24.664116 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:24.796358 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:08:24.804673 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-d9b99556-fdfa-4bb0-a489-d0905fec68e6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1451 microversion: 2.1 time: 0.152785 Jan 19 01:08:24.805250 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 563/1170] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:08:24 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:08:26.542640 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-e89b3a84-7e45-47db-bc61-a7973ddacf74 req-490ecaeb-08cd-4bbb-b277-a30340af6d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecd3e47-774a-4da3-b470-3012545d8b69", "tag": "ea54a915-7d54-4b44-9b45-f5261234d2b2"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:08:26.543843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:08:26.543843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:08:26.552153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-e89b3a84-7e45-47db-bc61-a7973ddacf74 req-490ecaeb-08cd-4bbb-b277-a30340af6d1d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:08:26.552610 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-e89b3a84-7e45-47db-bc61-a7973ddacf74 req-490ecaeb-08cd-4bbb-b277-a30340af6d1d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:08:26.564107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-e89b3a84-7e45-47db-bc61-a7973ddacf74 req-490ecaeb-08cd-4bbb-b277-a30340af6d1d service nova] Creating event network-changed:ea54a915-7d54-4b44-9b45-f5261234d2b2 for instance aecd3e47-774a-4da3-b470-3012545d8b69 on hv-cinder-79987 Jan 19 01:08:26.570191 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-e89b3a84-7e45-47db-bc61-a7973ddacf74 req-490ecaeb-08cd-4bbb-b277-a30340af6d1d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031336 Jan 19 01:08:26.571171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 608/1171] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:09:01.586863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:09:01.587629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:10:24.120019 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:24.120608 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:24.126367 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:24.126812 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:24.127581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:24.128015 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:24.151731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:10:24.226951 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1e1fcce1-f3e0-4475-bba1-c01658025d15 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 204 len: 0 microversion: 2.1 time: 0.111175 Jan 19 01:10:24.227569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 564/1172] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:10:24 2022] DELETE /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:10:24.237442 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:24.238171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:24.244681 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:24.245131 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:24.245977 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:24.246417 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:24.740316 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:24.747489 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-11e94965-1300-4f74-80b4-4af95748c153 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1576 microversion: 2.1 time: 0.515380 Jan 19 01:10:24.748049 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 609/1173] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:24 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1576 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:25.764510 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:25.765876 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:25.772244 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:25.772692 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:25.773473 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:25.773940 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:25.960419 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:25.967698 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-9fd6fc88-04a3-4cab-b1c7-8803cfd667bf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1576 microversion: 2.1 time: 0.207214 Jan 19 01:10:25.968258 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 565/1174] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:25 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:26.985846 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:26.986473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:26.992775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:26.993222 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:26.994036 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:26.994473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:27.064533 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:27.072108 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-e33b297f-6810-476e-8768-058d2c6393cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1508 microversion: 2.1 time: 0.091575 Jan 19 01:10:27.072692 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 610/1175] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:26 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:27.204841 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-91f8d095-e4cf-4333-a786-749d0efffc02 req-16dd11e2-7217-42f0-9f60-b821e8fb8121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecd3e47-774a-4da3-b470-3012545d8b69", "name": "network-vif-deleted", "tag": "ea54a915-7d54-4b44-9b45-f5261234d2b2"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:10:27.206604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:10:27.206604 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:10:27.214455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-91f8d095-e4cf-4333-a786-749d0efffc02 req-16dd11e2-7217-42f0-9f60-b821e8fb8121 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:27.214969 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-91f8d095-e4cf-4333-a786-749d0efffc02 req-16dd11e2-7217-42f0-9f60-b821e8fb8121 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:27.227473 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-91f8d095-e4cf-4333-a786-749d0efffc02 req-16dd11e2-7217-42f0-9f60-b821e8fb8121 service nova] Creating event network-vif-deleted:ea54a915-7d54-4b44-9b45-f5261234d2b2 for instance aecd3e47-774a-4da3-b470-3012545d8b69 on hv-cinder-79987 Jan 19 01:10:27.232576 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-91f8d095-e4cf-4333-a786-749d0efffc02 req-16dd11e2-7217-42f0-9f60-b821e8fb8121 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109464 Jan 19 01:10:27.233182 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 566/1176] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:10:28.089411 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:28.090074 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:28.097500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:28.098075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:28.099114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:28.099712 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:28.135618 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:28.136075 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:28.136531 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lazy-loading 'fault' on Instance uuid aecd3e47-774a-4da3-b470-3012545d8b69 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:10:28.178153 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:28.184831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-8d4c3bc7-4ebc-4142-bd0d-bd4fade18e05 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 200 len: 1183 microversion: 2.1 time: 0.099710 Jan 19 01:10:28.185389 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 611/1177] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:28 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:29.203827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:29.204440 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:29.212325 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:29.212771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:29.213581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:29.214025 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:29.229614 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] HTTP exception thrown: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. Jan 19 01:10:29.230239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Returning 404 to user: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:10:29.231061 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e552151b-9e17-4322-9403-30038e4bc52e tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 404 len: 111 microversion: 2.1 time: 0.032025 Jan 19 01:10:29.231645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 567/1178] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:29 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:10:29.326593 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1823705818", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931878432", "security_groups": [{"name": "tempest-secgroup-smoke-1242295534"}], "block_device_mapping_v2": [{"uuid": "e71a412f-f9a0-46c2-8dc6-233032b4e5f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb720cae-4dad-4da6-a242-4f7886e697d6"}]}} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:10:29.433847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.network.neutron [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] validate_networks() for [('bb720cae-4dad-4da6-a242-4f7886e697d6', None, None, None, None, None)] {{(pid=116545) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:10:29.845294 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:10:29.845772 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image limits 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:10:29.846253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:10:29.846667 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image pref 0:0:0 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:10:29.847090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.virt.hardware [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:10:29.855595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:29.856050 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:29.856863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:29.857309 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:29.873891 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:10:29.877711 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.quota [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for user ca33b346a78845b7a859638cff3e6277 and project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116545) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:10:29.932671 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Going to run 1 instances... {{(pid=116545) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:10:29.934834 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e71a412f-f9a0-46c2-8dc6-233032b4e5f6',volume_size=None,volume_type=None)] {{(pid=116545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:10:30.054171 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cd16759e-16fe-4f67-a4d4-c3e71fac82d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731185 Jan 19 01:10:30.054813 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 612/1179] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:10:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:10:30.064689 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-658ad300-947d-499c-9efb-0aa5f9459d21 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:30.065389 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-658ad300-947d-499c-9efb-0aa5f9459d21 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:30.117260 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-658ad300-947d-499c-9efb-0aa5f9459d21 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:30.123766 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-658ad300-947d-499c-9efb-0aa5f9459d21 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1095 microversion: 2.1 time: 0.062891 Jan 19 01:10:30.124345 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 568/1180] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:30 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:10:31.140580 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:31.141205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:31.147397 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:31.147863 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:31.148660 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:31.149107 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:31.210829 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:31.218169 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-c7912174-6733-489f-a18f-e4c80d30ce93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1193 microversion: 2.1 time: 0.081733 Jan 19 01:10:31.219254 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 613/1181] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:31 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:32.235627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:32.236594 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:32.245973 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:32.246700 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:32.247853 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:32.248359 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:32.405883 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:32.415171 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dad6cbe2-42e4-4d12-87b4-b5bbb8c4cdf1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.183120 Jan 19 01:10:32.416199 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 569/1182] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:32 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:10:32.636060 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-381d7a6d-3bd0-4c47-9c77-00a73956a90f req-8b38f580-289c-40f2-8a0b-2f109537e4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735db552-ef39-431c-a9e8-7d1238b61a4e", "tag": "35f0b692-4008-4607-bb29-be2988c13312"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:10:32.637858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:10:32.637858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:10:32.650823 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-381d7a6d-3bd0-4c47-9c77-00a73956a90f req-8b38f580-289c-40f2-8a0b-2f109537e4f8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:32.654858 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-381d7a6d-3bd0-4c47-9c77-00a73956a90f req-8b38f580-289c-40f2-8a0b-2f109537e4f8 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:32.669764 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-381d7a6d-3bd0-4c47-9c77-00a73956a90f req-8b38f580-289c-40f2-8a0b-2f109537e4f8 service nova] Creating event network-changed:35f0b692-4008-4607-bb29-be2988c13312 for instance 735db552-ef39-431c-a9e8-7d1238b61a4e on hv-cinder-79987 Jan 19 01:10:32.676496 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-381d7a6d-3bd0-4c47-9c77-00a73956a90f req-8b38f580-289c-40f2-8a0b-2f109537e4f8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043733 Jan 19 01:10:32.677737 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 614/1183] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:10:33.432605 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:33.433239 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:33.439464 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:33.439901 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:33.440676 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:33.441102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:33.573369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:33.580670 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4b6c89b7-2309-4a58-90f0-55a1d34ea286 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.151717 Jan 19 01:10:33.581542 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 570/1184] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:33 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:34.597297 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:34.597939 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:34.604423 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:34.604877 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:34.605695 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:34.606141 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:34.736552 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:34.743819 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-64b84222-8a35-4c82-ae78-e943a724dc18 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.150639 Jan 19 01:10:34.744383 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 615/1185] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:34 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:35.761190 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:35.761827 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:35.768138 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:35.768595 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:35.769378 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:35.769859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:35.901048 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:35.908777 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1be8a3b9-e9dc-4a3d-a598-a19436bc9755 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.151324 Jan 19 01:10:35.909341 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 571/1186] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:35 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:36.926030 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:36.926729 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:36.932914 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:36.933365 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:36.934182 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:36.934630 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:37.068207 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:37.075742 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-3566fb9f-91e2-4103-8191-8f7ebdcfe3ee tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.154182 Jan 19 01:10:37.076312 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 616/1187] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:36 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:38.092060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:38.092660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:38.099488 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:38.099946 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:38.100731 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:38.101173 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:38.228575 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:38.236454 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ebd418c6-216e-42dc-8acb-75b5e24193bc tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.148114 Jan 19 01:10:38.237028 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 572/1188] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:38 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:39.253279 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:39.253936 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:39.259855 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:39.260307 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:39.261277 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:39.261756 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:39.389811 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:39.397495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dfd5fb84-7ca3-4bf9-aadc-cd601bddaa56 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.149172 Jan 19 01:10:39.398090 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 617/1189] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:39 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:40.414833 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:40.415457 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:40.422368 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:40.422826 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:40.423617 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:40.424057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:40.554873 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:40.562237 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-644a78ac-33fe-4ce6-aab2-7492f331cc59 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.151166 Jan 19 01:10:40.562811 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 573/1190] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:40 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:41.580727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:41.581283 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:41.587535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:41.587989 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:41.588773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:41.589205 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:41.721290 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:41.728464 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-68e255f0-dee4-4e6b-ac0a-2e92997a7877 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.153322 Jan 19 01:10:41.729037 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 618/1191] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:41 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:42.647476 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-85563ec7-f99b-4c41-88cc-e99907d944f8 req-f0ea5995-6cb6-426e-ad58-5f95ec0008c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735db552-ef39-431c-a9e8-7d1238b61a4e", "name": "network-vif-plugged", "status": "completed", "tag": "35f0b692-4008-4607-bb29-be2988c13312"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:10:42.649095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:10:42.649095 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:10:42.656506 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-85563ec7-f99b-4c41-88cc-e99907d944f8 req-f0ea5995-6cb6-426e-ad58-5f95ec0008c1 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:42.656954 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-85563ec7-f99b-4c41-88cc-e99907d944f8 req-f0ea5995-6cb6-426e-ad58-5f95ec0008c1 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:42.667569 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-85563ec7-f99b-4c41-88cc-e99907d944f8 req-f0ea5995-6cb6-426e-ad58-5f95ec0008c1 service nova] Creating event network-vif-plugged:35f0b692-4008-4607-bb29-be2988c13312 for instance 735db552-ef39-431c-a9e8-7d1238b61a4e on hv-cinder-79987 Jan 19 01:10:42.673047 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-85563ec7-f99b-4c41-88cc-e99907d944f8 req-f0ea5995-6cb6-426e-ad58-5f95ec0008c1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086195 Jan 19 01:10:42.673658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 574/1192] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:10:42.744847 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:42.745465 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:42.751667 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:42.752123 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:42.752906 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:42.753345 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:42.888513 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:42.896363 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-d04a497d-6683-4cbf-9f58-97496752b471 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.155245 Jan 19 01:10:42.896950 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 619/1193] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:42 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:43.915011 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:43.915713 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:43.921817 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:43.922267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:43.923037 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:43.923606 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:44.059931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:44.068223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-68211fa1-edbc-4a64-9963-5624012c0d58 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1267 microversion: 2.1 time: 0.157657 Jan 19 01:10:44.068802 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 575/1194] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:43 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:45.084727 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:45.085379 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:45.091508 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:45.091955 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:45.092734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:45.093172 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:45.224761 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:45.232048 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-aa16bfe2-bc80-42ee-80a8-b2fef4048349 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1453 microversion: 2.1 time: 0.150962 Jan 19 01:10:45.232619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 620/1195] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:45 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:45.247776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:10:45.248369 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:10:45.260672 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:45.261142 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:45.261981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:45.262427 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:45.391102 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:10:45.398552 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-4318d073-4627-46e5-b530-e22b57406e83 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1453 microversion: 2.1 time: 0.154377 Jan 19 01:10:45.399117 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 576/1196] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:10:45 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:10:47.306517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-f0350740-339d-47a3-a0f5-1260014ea2ed req-339c32f6-0cd7-42e5-b8e4-7c94d675cc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735db552-ef39-431c-a9e8-7d1238b61a4e", "tag": "35f0b692-4008-4607-bb29-be2988c13312"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:10:47.308033 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:10:47.308033 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:10:47.315319 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-f0350740-339d-47a3-a0f5-1260014ea2ed req-339c32f6-0cd7-42e5-b8e4-7c94d675cc25 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:10:47.315770 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-f0350740-339d-47a3-a0f5-1260014ea2ed req-339c32f6-0cd7-42e5-b8e4-7c94d675cc25 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:10:47.328577 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-f0350740-339d-47a3-a0f5-1260014ea2ed req-339c32f6-0cd7-42e5-b8e4-7c94d675cc25 service nova] Creating event network-changed:35f0b692-4008-4607-bb29-be2988c13312 for instance 735db552-ef39-431c-a9e8-7d1238b61a4e on hv-cinder-79987 Jan 19 01:10:47.333586 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-f0350740-339d-47a3-a0f5-1260014ea2ed req-339c32f6-0cd7-42e5-b8e4-7c94d675cc25 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092480 Jan 19 01:10:47.334186 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 621/1197] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:10:48.742674 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:10:48.743254 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:10:51.795517 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:10:51.796039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:12:24.359158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1838208310", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931878432", "security_groups": [{"name": "tempest-secgroup-smoke-1242295534"}], "block_device_mapping_v2": [{"uuid": "4f7b26c0-76d5-4aee-8014-3f02bc162d5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb720cae-4dad-4da6-a242-4f7886e697d6"}]}} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:12:24.471145 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.network.neutron [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] validate_networks() for [('bb720cae-4dad-4da6-a242-4f7886e697d6', None, None, None, None, None)] {{(pid=116543) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 01:12:24.940782 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 01:12:24.941213 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image limits 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 01:12:24.941716 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Flavor pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 01:12:24.942218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Image pref 0:0:0 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 01:12:24.942654 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.virt.hardware [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 01:12:24.951214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:24.951661 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:24.952463 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:24.953045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:24.969577 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 01:12:24.974185 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.quota [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Getting quotas for user ca33b346a78845b7a859638cff3e6277 and project 8e01579e07bf4fb4b649e597de305f47. Resources: {'ram', 'instances', 'cores'} {{(pid=116543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 01:12:25.030463 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Going to run 1 instances... {{(pid=116543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 01:12:25.032971 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f7b26c0-76d5-4aee-8014-3f02bc162d5e',volume_size=None,volume_type=None)] {{(pid=116543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 01:12:25.149700 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b6a8203a-ce69-44ed-938d-abb79774e82a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799071 Jan 19 01:12:25.150336 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 577/1198] 10.222.0.35 () {60 vars in 1146 bytes} [Wed Jan 19 01:12:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 01:12:25.162019 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-dcfd31ba-28af-458a-8514-97cfa461a79c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:25.162721 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-dcfd31ba-28af-458a-8514-97cfa461a79c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:25.215455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-dcfd31ba-28af-458a-8514-97cfa461a79c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:25.222024 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-dcfd31ba-28af-458a-8514-97cfa461a79c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1095 microversion: 2.1 time: 0.065521 Jan 19 01:12:25.222595 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 622/1199] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:25 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:26.241443 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:26.241904 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:26.247645 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:26.248109 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:26.248893 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:26.249334 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:26.312750 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:26.320667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-1d1a799a-a440-4311-871b-bd976ad98e93 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1193 microversion: 2.1 time: 0.085178 Jan 19 01:12:26.321234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 578/1200] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:26 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:27.338609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:27.339170 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:27.346473 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:27.347043 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:27.347890 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:27.348460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:27.548434 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:27.555918 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-469410bc-59cb-4052-8f0c-ddcef770e2e2 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.221302 Jan 19 01:12:27.556488 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 623/1201] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:27 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:12:27.824667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-46509c06-30ef-4485-9810-36ec8a1e3a2b req-ae05b256-f918-4ff4-8bfe-151bebdec544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d277b8-dcb2-41d8-8407-4c4a885bd617", "tag": "384b3e87-fe40-4b32-a0e1-9d41ef471c6f"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:12:27.826269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:12:27.826269 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:12:27.833806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-46509c06-30ef-4485-9810-36ec8a1e3a2b req-ae05b256-f918-4ff4-8bfe-151bebdec544 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:27.834252 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-46509c06-30ef-4485-9810-36ec8a1e3a2b req-ae05b256-f918-4ff4-8bfe-151bebdec544 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:27.853215 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-46509c06-30ef-4485-9810-36ec8a1e3a2b req-ae05b256-f918-4ff4-8bfe-151bebdec544 service nova] Creating event network-changed:384b3e87-fe40-4b32-a0e1-9d41ef471c6f for instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 on hv-cinder-79987 Jan 19 01:12:27.858223 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-46509c06-30ef-4485-9810-36ec8a1e3a2b req-ae05b256-f918-4ff4-8bfe-151bebdec544 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037099 Jan 19 01:12:27.858907 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 579/1202] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:12:28.572188 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:28.572816 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:28.578799 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:28.579252 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:28.580038 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:28.580501 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:28.749616 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:28.757601 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-690f7a3e-2198-455a-9fb1-c1f41d2f75a1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.189192 Jan 19 01:12:28.758195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 624/1203] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:28 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:29.776504 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:29.777200 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:29.783387 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:29.783839 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:29.784620 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:29.785060 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:29.914307 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:29.921514 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-c0961ecd-481f-4809-9f24-eb162e9b3d7a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.149509 Jan 19 01:12:29.922107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 580/1204] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:29 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:30.938385 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:30.938993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:30.945875 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:30.946336 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:30.947115 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:30.947556 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:31.077052 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:31.084388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cab45999-2c6b-4692-9c7e-84ad1f866913 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.149874 Jan 19 01:12:31.084954 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 625/1205] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:30 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:32.100438 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:32.101045 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:32.107282 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:32.107738 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:32.108500 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:32.108927 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:32.245937 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:32.253205 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-b6408ad6-61a0-4bd8-8c79-c6a164b578e9 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.156908 Jan 19 01:12:32.253806 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 581/1206] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:32 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:33.269638 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:33.270274 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:33.276553 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:33.277008 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:33.277832 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:33.278261 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:33.409838 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:33.417637 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-92b18db0-eb75-4f0b-a4a4-a6dc238f3979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.151758 Jan 19 01:12:33.418213 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 626/1207] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:33 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:34.435001 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:34.435684 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:34.441849 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:34.442291 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:34.443662 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:34.444096 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:34.574819 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:34.582294 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-78b0a4e0-239b-4156-8783-799649e71c1a tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.150998 Jan 19 01:12:34.582864 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 582/1208] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:34 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:35.599801 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:35.600414 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:35.606656 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:35.607114 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:35.607907 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:35.608350 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:35.743275 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:35.750500 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-77c687d8-6bd3-4750-bd95-bbfe980bd979 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.154968 Jan 19 01:12:35.751250 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 627/1209] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:35 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:36.767494 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:36.768114 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:36.774555 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:36.775007 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:36.775788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:36.776231 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:36.908009 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:36.916477 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ad4bb215-cee6-4bd6-a983-bdc20b895bad tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.152850 Jan 19 01:12:36.917051 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 583/1210] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:36 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:37.317436 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-9ab7976b-772b-43b7-8706-0ac1293b136d req-287dd5e8-c636-4f42-89e2-8bef7552d332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d277b8-dcb2-41d8-8407-4c4a885bd617", "name": "network-vif-plugged", "status": "completed", "tag": "384b3e87-fe40-4b32-a0e1-9d41ef471c6f"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:12:37.319093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:12:37.319093 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:12:37.327077 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-9ab7976b-772b-43b7-8706-0ac1293b136d req-287dd5e8-c636-4f42-89e2-8bef7552d332 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:37.327609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-9ab7976b-772b-43b7-8706-0ac1293b136d req-287dd5e8-c636-4f42-89e2-8bef7552d332 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:37.339843 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-9ab7976b-772b-43b7-8706-0ac1293b136d req-287dd5e8-c636-4f42-89e2-8bef7552d332 service nova] Creating event network-vif-plugged:384b3e87-fe40-4b32-a0e1-9d41ef471c6f for instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 on hv-cinder-79987 Jan 19 01:12:37.344932 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-9ab7976b-772b-43b7-8706-0ac1293b136d req-287dd5e8-c636-4f42-89e2-8bef7552d332 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031119 Jan 19 01:12:37.345532 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 628/1211] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:12:37.932840 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:37.933393 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:37.939723 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:37.940178 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:37.940959 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:37.941401 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:38.071658 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:38.079010 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e15f0d57-d412-4e1a-a67b-ec7d03f05f87 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1267 microversion: 2.1 time: 0.149919 Jan 19 01:12:38.079581 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 584/1212] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:37 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:39.096734 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:39.097430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:39.104548 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:39.105002 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:39.105815 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:39.106255 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:39.239619 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:39.247001 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-fe129b3a-cc3a-455a-bc42-62d34c8e5126 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1454 microversion: 2.1 time: 0.154322 Jan 19 01:12:39.247585 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 629/1213] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:39 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:39.265429 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:12:39.266287 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:12:39.273094 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:39.273530 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:39.274349 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:39.274788 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:39.403515 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:12:39.410949 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-705837c4-3aca-4210-ae3b-eeb966034d0f tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1454 microversion: 2.1 time: 0.151389 Jan 19 01:12:39.411515 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 585/1214] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:12:39 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:12:40.990483 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-47bd85d3-7cc6-4810-aa66-885c3c03db57 req-28ea3c4a-6f3c-4ec6-b5f6-dc026406025d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d277b8-dcb2-41d8-8407-4c4a885bd617", "tag": "384b3e87-fe40-4b32-a0e1-9d41ef471c6f"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:12:40.992014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:12:40.992014 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:12:40.999430 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-47bd85d3-7cc6-4810-aa66-885c3c03db57 req-28ea3c4a-6f3c-4ec6-b5f6-dc026406025d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:12:40.999880 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-47bd85d3-7cc6-4810-aa66-885c3c03db57 req-28ea3c4a-6f3c-4ec6-b5f6-dc026406025d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:12:41.011521 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-47bd85d3-7cc6-4810-aa66-885c3c03db57 req-28ea3c4a-6f3c-4ec6-b5f6-dc026406025d service nova] Creating event network-changed:384b3e87-fe40-4b32-a0e1-9d41ef471c6f for instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 on hv-cinder-79987 Jan 19 01:12:41.016782 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-47bd85d3-7cc6-4810-aa66-885c3c03db57 req-28ea3c4a-6f3c-4ec6-b5f6-dc026406025d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Jan 19 01:12:41.017633 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 630/1215] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:14:08.750956 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:14:08.751587 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:14:11.804972 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:14:11.805578 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:14:13.560743 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:13.561475 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:13.563888 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-beb32cee-c18e-4063-9b76-e60c472e32c5 req-d6faaf73-e9b7-4db7-b3a3-e4865b07dd28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d277b8-dcb2-41d8-8407-4c4a885bd617", "tag": "384b3e87-fe40-4b32-a0e1-9d41ef471c6f"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:14:13.565388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:14:13.565388 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:14:13.569238 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:13.569945 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:13.570981 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:13.571621 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:13.573272 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-beb32cee-c18e-4063-9b76-e60c472e32c5 req-d6faaf73-e9b7-4db7-b3a3-e4865b07dd28 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:13.573773 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-beb32cee-c18e-4063-9b76-e60c472e32c5 req-d6faaf73-e9b7-4db7-b3a3-e4865b07dd28 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:13.585360 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-beb32cee-c18e-4063-9b76-e60c472e32c5 req-d6faaf73-e9b7-4db7-b3a3-e4865b07dd28 service nova] Creating event network-changed:384b3e87-fe40-4b32-a0e1-9d41ef471c6f for instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 on hv-cinder-79987 Jan 19 01:14:13.591068 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-beb32cee-c18e-4063-9b76-e60c472e32c5 req-d6faaf73-e9b7-4db7-b3a3-e4865b07dd28 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033539 Jan 19 01:14:13.591983 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 631/1216] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:14:13.598813 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Going to try to terminate instance {{(pid=116543) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:14:13.676057 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-ee1d5654-ace2-41d8-9454-59c8c9e1b51d tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 204 len: 0 microversion: 2.1 time: 0.120791 Jan 19 01:14:13.687280 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:13.688338 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:13.691062 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 586/1217] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:14:13 2022] DELETE /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:14:13.694806 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:13.695334 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:13.696257 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:13.696831 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:13.940957 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:13.947824 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-ce3332fa-985b-4557-8867-b76a767d3450 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1579 microversion: 2.1 time: 0.265457 Jan 19 01:14:13.948510 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 632/1218] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:13 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1579 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:14:14.966248 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:14.966884 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:14.973218 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:14.973706 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:14.974498 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:14.974947 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:15.107931 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:15.115214 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-dc9a8863-28a5-4ff2-8045-f333a2deced1 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1460 microversion: 2.1 time: 0.153710 Jan 19 01:14:15.115794 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 587/1219] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:14 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:14:16.132056 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:16.132655 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:16.138706 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:16.139165 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:16.139983 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:16.140458 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:16.346233 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:16.354609 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-b80078ca-5c24-4b30-a3e0-abb224314644 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1460 microversion: 2.1 time: 0.226169 Jan 19 01:14:16.355195 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 633/1220] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:16 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1460 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 01:14:16.497319 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-0dcc4c84-684e-48d2-8d43-bf54a7fbbb35 req-5d52edb0-6503-4217-8e8e-63b54c2e937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d277b8-dcb2-41d8-8407-4c4a885bd617", "name": "network-vif-deleted", "tag": "384b3e87-fe40-4b32-a0e1-9d41ef471c6f"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:14:16.499858 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:14:16.499858 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:14:16.509002 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-0dcc4c84-684e-48d2-8d43-bf54a7fbbb35 req-5d52edb0-6503-4217-8e8e-63b54c2e937d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:16.509455 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-0dcc4c84-684e-48d2-8d43-bf54a7fbbb35 req-5d52edb0-6503-4217-8e8e-63b54c2e937d service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:16.521373 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-0dcc4c84-684e-48d2-8d43-bf54a7fbbb35 req-5d52edb0-6503-4217-8e8e-63b54c2e937d service nova] Creating event network-vif-deleted:384b3e87-fe40-4b32-a0e1-9d41ef471c6f for instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 on hv-cinder-79987 Jan 19 01:14:16.526263 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-0dcc4c84-684e-48d2-8d43-bf54a7fbbb35 req-5d52edb0-6503-4217-8e8e-63b54c2e937d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Jan 19 01:14:16.527158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 588/1221] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 01:14:17.371248 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:17.372476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:17.379086 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:17.379535 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:17.380321 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:17.380758 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:17.410474 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:17.410924 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:17.411374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.objects.instance [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lazy-loading 'fault' on Instance uuid c4d277b8-dcb2-41d8-8407-4c4a885bd617 {{(pid=116545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 01:14:17.452460 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:17.458993 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-011ded06-16c1-4ef4-8e96-b0656e6412fe tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 200 len: 1185 microversion: 2.1 time: 0.091414 Jan 19 01:14:17.459564 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 634/1222] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:17 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 1185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:14:18.476820 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:18.477517 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: c4d277b8-dcb2-41d8-8407-4c4a885bd617] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:18.483603 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:18.484053 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:18.484830 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:18.485267 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:18.498521 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] HTTP exception thrown: Instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 could not be found. Jan 19 01:14:18.499107 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Returning 404 to user: Instance c4d277b8-dcb2-41d8-8407-4c4a885bd617 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:14:18.499925 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-e0ae5c53-c182-4ec5-a6f6-9981e35a24f3 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617" status: 404 len: 111 microversion: 2.1 time: 0.027627 Jan 19 01:14:18.500454 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 589/1223] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:18 2022] GET /compute/v2.1/servers/c4d277b8-dcb2-41d8-8407-4c4a885bd617 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:14:21.536775 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:21.537444 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:21.538637 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [req-d53fbbea-87ea-47cb-89c1-5801c9e4a7aa req-ffe0efcc-3876-46f5-92c2-9363c0011b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735db552-ef39-431c-a9e8-7d1238b61a4e", "tag": "35f0b692-4008-4607-bb29-be2988c13312"}]} {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:14:21.540169 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:14:21.540169 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: warnings.warn(msg) Jan 19 01:14:21.543565 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:21.544805 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:21.545620 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:21.546062 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:21.547571 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d53fbbea-87ea-47cb-89c1-5801c9e4a7aa req-ffe0efcc-3876-46f5-92c2-9363c0011b3c service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:21.548020 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [req-d53fbbea-87ea-47cb-89c1-5801c9e4a7aa req-ffe0efcc-3876-46f5-92c2-9363c0011b3c service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:21.561936 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.compute.server_external_events [req-d53fbbea-87ea-47cb-89c1-5801c9e4a7aa req-ffe0efcc-3876-46f5-92c2-9363c0011b3c service nova] Creating event network-changed:35f0b692-4008-4607-bb29-be2988c13312 for instance 735db552-ef39-431c-a9e8-7d1238b61a4e on hv-cinder-79987 Jan 19 01:14:21.567013 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [req-d53fbbea-87ea-47cb-89c1-5801c9e4a7aa req-ffe0efcc-3876-46f5-92c2-9363c0011b3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Jan 19 01:14:21.567843 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 590/1224] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:14:21.573974 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Going to try to terminate instance {{(pid=116545) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 01:14:21.655984 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-cd04baac-c768-432f-9df9-3caa941fe8d6 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "DELETE /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 204 len: 0 microversion: 2.1 time: 0.122359 Jan 19 01:14:21.661282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 635/1225] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:14:21 2022] DELETE /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 01:14:21.665742 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:21.666660 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:21.673360 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:21.674079 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:21.675540 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:21.676370 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:21.811018 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:21.818859 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-343f6182-6d06-422a-93f7-25a8c065832c tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1578 microversion: 2.1 time: 0.157309 Jan 19 01:14:21.819627 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 591/1226] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:21 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:14:22.837495 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:22.838282 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:22.846228 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:22.846684 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:22.847467 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:22.847911 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:22.981293 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.policy [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116545) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:22.988628 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-827566b5-a5b9-4236-9727-f697a21743ff tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1459 microversion: 2.1 time: 0.155428 Jan 19 01:14:22.989201 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 636/1227] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:22 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:14:24.005134 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:24.005790 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:24.013158 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:24.013667 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:24.014480 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:24.014955 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:24.052942 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [req-6d5ed67d-8f85-4eee-b76b-f327be6cff53 req-37d77fae-0acb-411c-a5e7-d563807a1963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735db552-ef39-431c-a9e8-7d1238b61a4e", "name": "network-vif-deleted", "tag": "35f0b692-4008-4607-bb29-be2988c13312"}]} {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 01:14:24.054747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 01:14:24.054747 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: warnings.warn(msg) Jan 19 01:14:24.062215 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-6d5ed67d-8f85-4eee-b76b-f327be6cff53 req-37d77fae-0acb-411c-a5e7-d563807a1963 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:24.062666 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [req-6d5ed67d-8f85-4eee-b76b-f327be6cff53 req-37d77fae-0acb-411c-a5e7-d563807a1963 service nova] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:24.073959 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.compute.server_external_events [req-6d5ed67d-8f85-4eee-b76b-f327be6cff53 req-37d77fae-0acb-411c-a5e7-d563807a1963 service nova] Creating event network-vif-deleted:35f0b692-4008-4607-bb29-be2988c13312 for instance 735db552-ef39-431c-a9e8-7d1238b61a4e on hv-cinder-79987 Jan 19 01:14:24.079882 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [req-6d5ed67d-8f85-4eee-b76b-f327be6cff53 req-37d77fae-0acb-411c-a5e7-d563807a1963 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Jan 19 01:14:24.080476 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 637/1228] 10.222.0.35 () {64 vars in 1317 bytes} [Wed Jan 19 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 01:14:24.081596 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.policy [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca33b346a78845b7a859638cff3e6277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e01579e07bf4fb4b649e597de305f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116543) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 01:14:24.091639 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-240fa13c-cf0f-478d-815f-b56666650856 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 200 len: 1391 microversion: 2.1 time: 0.089560 Jan 19 01:14:24.092227 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 592/1229] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:24 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 1391 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 01:14:25.109967 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:25.110702 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: 735db552-ef39-431c-a9e8-7d1238b61a4e] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:25.116796 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.117251 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.118066 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.118507 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.132039 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] HTTP exception thrown: Instance 735db552-ef39-431c-a9e8-7d1238b61a4e could not be found. Jan 19 01:14:25.132629 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Returning 404 to user: Instance 735db552-ef39-431c-a9e8-7d1238b61a4e could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:14:25.133455 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-1d292208-5155-491c-8e57-dfc2b5a26051 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e" status: 404 len: 111 microversion: 2.1 time: 0.028472 Jan 19 01:14:25.134023 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 638/1230] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:25 2022] GET /compute/v2.1/servers/735db552-ef39-431c-a9e8-7d1238b61a4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 01:14:25.580771 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:25.581266 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.compute.api [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116543) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:25.587655 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.588111 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.588892 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.589341 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG oslo_concurrency.lockutils [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.602810 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.wsgi [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] HTTP exception thrown: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. Jan 19 01:14:25.603398 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Returning 404 to user: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. {{(pid=116543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:14:25.604234 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-80d4bd57-858a-41cb-9b39-5e430396f000 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 404 len: 111 microversion: 2.1 time: 0.027278 Jan 19 01:14:25.604776 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 593/1231] 10.222.0.35 () {58 vars in 1238 bytes} [Wed Jan 19 01:14:25 2022] DELETE /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:14:25.612598 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '>' {{(pid=116545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:25.613210 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.compute.api [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] [instance: aecd3e47-774a-4da3-b470-3012545d8b69] Fetching instance by UUID {{(pid=116545) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 01:14:25.618894 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.619349 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.620129 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 01:14:25.620574 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG oslo_concurrency.lockutils [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Lock "23fbd8cf-57fa-48c6-8c92-2946764f5e06" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 01:14:25.633658 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.wsgi [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] HTTP exception thrown: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. Jan 19 01:14:25.634253 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: DEBUG nova.api.openstack.wsgi [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Returning 404 to user: Instance aecd3e47-774a-4da3-b470-3012545d8b69 could not be found. {{(pid=116545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 01:14:25.635071 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO nova.api.openstack.requestlog [None req-5e27be16-f9a9-4c1a-a892-af5dae7be1cf tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69" status: 404 len: 111 microversion: 2.1 time: 0.026153 Jan 19 01:14:25.635702 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: [pid: 116545|app: 0|req: 639/1232] 10.222.0.35 () {58 vars in 1235 bytes} [Wed Jan 19 01:14:25 2022] GET /compute/v2.1/servers/aecd3e47-774a-4da3-b470-3012545d8b69 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 01:14:26.927394 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: DEBUG nova.api.openstack.wsgi [None req-42b66a12-9f73-40f8-b25e-fd4c49f796d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] Calling method '.version_select at 0x7f934c5e9550>' {{(pid=116543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 01:14:26.949312 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO nova.api.openstack.requestlog [None req-42b66a12-9f73-40f8-b25e-fd4c49f796d5 tempest-TestVolumeBootPattern-1628530261 tempest-TestVolumeBootPattern-1628530261-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1931878432" status: 202 len: 0 microversion: 2.1 time: 0.025372 Jan 19 01:14:26.950626 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: [pid: 116543|app: 0|req: 594/1233] 10.222.0.35 () {58 vars in 1262 bytes} [Wed Jan 19 01:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1931878432 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 01:15:34.427495 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:15:34.428210 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:15:41.602475 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:15:41.603020 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:17:28.760235 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:17:28.760852 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:17:31.813757 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:17:31.814300 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:17:33.848445 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:17:33.848952 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:18:54.436058 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:18:54.436778 dv-cinder-799871-14-iscsi devstack@n-api.service[116543]: Wed Jan 19 01:18:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:19:01.610575 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:19:01.611160 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 01:19:33.769374 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 01:19:33.770235 dv-cinder-799871-14-iscsi devstack@n-api.service[116545]: Wed Jan 19 01:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!